-- Logs begin at Tue 2022-08-30 23:31:58 UTC, end at Wed 2022-08-31 00:53:18 UTC. -- Aug 31 00:25:50.971633 dv-cinder-852211-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 00:25:50.981715 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 00:25:50.983683 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 00:25:50 2022] *** Aug 31 00:25:50.983683 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 00:25:50.983683 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 00:25:50.983683 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: nodename: dv-cinder-852211-6-iscsi Aug 31 00:25:50.983683 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: machine: x86_64 Aug 31 00:25:50.983683 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: clock source: unix Aug 31 00:25:50.983683 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: pcre jit disabled Aug 31 00:25:50.983683 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: detected number of CPU cores: 4 Aug 31 00:25:50.983683 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: current working directory: / Aug 31 00:25:50.983683 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: detected binary path: /usr/bin/uwsgi-core Aug 31 00:25:50.984411 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: your processes number limit is 47680 Aug 31 00:25:50.984411 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: your memory page size is 4096 bytes Aug 31 00:25:50.984411 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: detected max file descriptor number: 2048 Aug 31 00:25:50.984411 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: lock engine: pthread robust mutexes Aug 31 00:25:50.984411 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: thunder lock: enabled Aug 31 00:25:50.984411 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 00:25:50.984411 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 00:25:51.022727 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: Python main interpreter initialized at 0x55fac514d9c0 Aug 31 00:25:51.022727 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: python threads support enabled Aug 31 00:25:51.022727 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: your server socket listen backlog is limited to 100 connections Aug 31 00:25:51.022727 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: your mercy for graceful operations on workers is 90 seconds Aug 31 00:25:51.023107 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 00:25:51.023185 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: *** Operational MODE: preforking *** Aug 31 00:25:51.023417 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: *** uWSGI is running in multiple interpreter mode *** Aug 31 00:25:51.023417 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: spawned uWSGI master process (pid: 112903) Aug 31 00:25:51.023676 dv-cinder-852211-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 00:25:51.024650 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: spawned uWSGI worker 1 (pid: 112904, cores: 1) Aug 31 00:25:51.024995 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: spawned uWSGI worker 2 (pid: 112905, cores: 1) Aug 31 00:25:51.025151 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 00:25:51.709216 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 00:25:51.710967 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 00:25:52.832432 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:25:52.832432 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: from cryptography.utils import int_from_bytes Aug 31 00:25:52.833142 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:25:52.833142 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: from cryptography.utils import int_from_bytes Aug 31 00:25:52.834777 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:25:52.834777 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: from cryptography.utils import int_from_bytes Aug 31 00:25:52.835205 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:25:52.835205 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: from cryptography.utils import int_from_bytes Aug 31 00:25:55.361284 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:25:55.361870 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:25:55.361975 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:25:55.361975 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:25:55.362394 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:25:55.362394 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:25:55.362567 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:25:55.362654 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:25:55.362807 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:25:55.363013 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.363142 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:25:55.363336 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.363453 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.363649 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.363738 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.363962 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.364050 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.364369 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.364510 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.364624 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.364720 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.364955 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.365046 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.365252 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.365359 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.365573 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.365670 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.365829 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.365915 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.366137 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.366229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.366448 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.366540 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-6-iscsi {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.366760 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.366845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-6-iscsi {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.367059 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.367147 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.367363 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.367462 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.367668 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.367751 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.367962 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.368064 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.368276 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.368402 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.368601 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.368698 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.368911 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.369091 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.369423 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.369544 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.369731 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.369825 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.370036 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.370137 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.370340 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.370449 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.370673 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.370783 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.371496 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.371668 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.371847 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.371959 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.372147 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.372355 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.372496 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.372690 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.372785 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.373019 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.373181 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-6-iscsi {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.373336 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.373499 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.373731 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-6-iscsi {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.373844 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.374047 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.374134 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.374360 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.374477 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.374674 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.374799 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.375075 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.375258 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.375379 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.375462 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.375690 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.375784 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.375985 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.376077 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.376306 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.376449 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.376632 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.376719 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.376950 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.377037 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.377263 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.377393 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.377560 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.377655 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.377895 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.377981 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.378198 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.378290 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.378512 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.378607 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.378812 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.378907 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.379110 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.379195 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.379355 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.379449 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.379656 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.379742 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.379971 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.380063 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.380276 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.380404 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.380615 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.380703 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.380861 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.380954 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.381107 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.381240 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.381419 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.381517 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.381729 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.381822 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.382030 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.382114 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.382337 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.382423 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.382638 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.382732 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.382939 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.383024 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.383239 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.383325 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.383543 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.383664 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.383847 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.383943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.384144 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.384242 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.384474 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.384569 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.384814 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.385379 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.385379 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.385529 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.385529 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.385668 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.385733 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.385815 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.386000 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.386093 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.386308 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.386394 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.386640 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.387247 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.387643 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.387762 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.387968 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.388057 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.388275 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.388405 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.388619 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.388716 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.388939 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.389041 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.389244 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.389339 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.389548 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.389642 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.389851 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.389938 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.390167 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.390259 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.390496 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.390591 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.390796 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.390882 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.391044 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.391153 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.391339 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.391458 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.391637 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.391730 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.391949 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.392041 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.392249 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.392379 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.392578 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.392666 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.392880 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.392966 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.393176 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.393264 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.393477 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.393563 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.393777 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.393867 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.394079 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.394187 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.394413 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.394512 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.394719 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.394813 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.395025 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.395112 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.395330 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.395424 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.395632 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.395726 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.395937 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.396031 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.396240 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.396355 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.396571 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.396671 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.396891 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.396977 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.397192 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.397287 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.397495 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.397590 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.397795 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.397895 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.398097 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.398191 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.398398 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.398499 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.398698 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.398797 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.399004 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.399090 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.399302 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.399393 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.399602 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.399689 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.399907 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.400000 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.400205 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.400356 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.400568 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.400664 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.400874 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.400968 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.401169 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.401272 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.401471 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.401559 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.401769 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.401854 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.402072 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.402170 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.402424 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.402517 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.402729 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.402941 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.403036 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.403155 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.403313 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.403462 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.403612 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.403767 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.403914 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.404074 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.404197 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.404402 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.404508 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.404709 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.404806 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.405012 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.405121 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.405310 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.405434 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.405630 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.405778 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.405952 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.406044 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.406261 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.406347 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.406570 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.406669 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.406877 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.406965 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.407194 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:25:55.407280 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.407528 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.407616 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.407856 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.407942 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.408183 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.408269 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.408521 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.408611 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.408829 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.408922 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.409138 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.409225 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.409459 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.409546 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.409765 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.409858 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.410073 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.410168 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.410380 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.410466 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.410692 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.410778 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.411006 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.411102 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.411331 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.411418 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.411642 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.411741 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.411951 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.412037 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.412265 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.412372 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.412600 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.412689 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.412914 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.413004 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.413232 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.413312 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.413545 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.413628 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.413851 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.413934 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.414183 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.414258 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.414507 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.414582 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.414818 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.414975 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.415137 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.415213 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.415514 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.415651 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.415776 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.415891 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.416045 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.416167 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.416375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.416506 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.416689 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.416823 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.417023 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.417137 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.417334 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.417448 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.417646 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.417766 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.417980 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.418115 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.418333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.418430 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.418608 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.418727 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.419005 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.419092 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.419316 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.419403 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.419625 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.419719 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.419932 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.420026 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.420240 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.420350 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.420832 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.420932 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.421145 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.421239 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.421456 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.421551 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.421764 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.421851 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.422077 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.422163 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.422389 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.422490 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.422697 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.422870 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.423004 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.423198 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.423291 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.423513 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.423601 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.423826 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.423911 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.424141 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.424234 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.424474 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.424564 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.424782 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.424869 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.425088 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.425187 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.425390 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.425597 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.425682 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.425760 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.426004 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.426113 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.426305 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.426390 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.426671 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.426771 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.426907 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.427004 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.427206 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.427293 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.427514 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.427600 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.427820 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.427921 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.428124 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.428278 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.428552 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.428645 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.428742 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.428824 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.429039 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.429146 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.429387 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.429474 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.429700 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.429799 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.430001 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.430089 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.430303 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.430388 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.430610 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.430697 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.430917 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.431006 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.431221 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.431307 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.431526 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.431619 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.431837 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.431923 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.432143 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.432243 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.432475 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.432577 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.432788 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.432876 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.433116 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.433214 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.433414 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.434027 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.434239 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.434333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.434575 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.434679 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.434907 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.434994 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.435214 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.435314 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.435519 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.435614 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.435819 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.435907 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.436133 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.436239 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.436446 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.436548 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.436755 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.436855 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.437050 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.437137 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.437350 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.437447 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.437650 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.437737 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.437949 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.438043 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.438253 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.438398 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.438553 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.438684 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.438858 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.438946 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.439155 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.439252 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.439455 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.439545 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.439753 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.439850 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.440068 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.440154 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.440395 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.440498 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.440704 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.440801 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.441008 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.441096 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.441349 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.441437 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.441653 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.441752 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.441961 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.442093 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.442279 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.442373 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.442585 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.442681 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.442892 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.442978 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.443196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.443294 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.443502 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.443597 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.443818 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.443904 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.444123 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.444210 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.444459 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.444550 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.444764 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.444856 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.445083 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.445167 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.445385 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.445471 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.445698 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.445785 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.445999 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.446085 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.446309 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.446406 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.446617 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.446711 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.446937 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.447025 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.447245 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.447344 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.447559 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.447646 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.447866 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.447968 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.448175 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.448262 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.448504 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.448606 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.448811 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.448916 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.449138 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.449236 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.450173 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.450325 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.450564 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.450658 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.450749 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.450829 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.450997 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.451087 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.451378 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.451493 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.451620 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.451709 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.451926 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.452014 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.452244 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.452366 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.452578 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.452667 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.452889 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.452985 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.453212 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.453300 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.453528 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.453620 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.453833 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.453926 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.454139 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.454225 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.454453 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.454539 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.454759 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.454845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.455064 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.455152 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.455384 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.455487 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.455668 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.455764 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.455968 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.456055 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.456272 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.456412 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.456606 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.456712 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.456908 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.457009 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.457257 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.457397 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.457545 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.457641 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.457853 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.457940 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.458157 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.458244 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.458509 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.458661 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.458754 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.458823 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.459048 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.459137 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.459367 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.459454 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.459673 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.459759 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.459989 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.460075 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.460299 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.460449 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.460623 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.460707 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.460924 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.461012 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.461242 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.461330 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.461547 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.461635 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.461846 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.461951 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.462150 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.462237 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.462449 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.462536 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.462784 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.462881 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.463090 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.463219 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.463435 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.463525 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.463737 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.463863 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.464048 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.464147 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.464379 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.464473 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.464695 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.464829 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.465084 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.465237 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.465388 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.465531 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.465694 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.465793 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.466003 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.466097 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.466308 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.466395 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.466615 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.466712 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.466921 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.467016 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.467227 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.467315 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.467533 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.467621 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.467849 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.467934 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.468151 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.468236 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.468480 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.468584 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.468793 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.468906 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.469092 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.469186 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.469401 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.469501 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.469709 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.469796 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.470016 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.470281 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.470385 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.470605 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.470693 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.470916 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.471008 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.471228 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.471487 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.471574 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.471824 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.471917 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.472143 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.472313 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.472496 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.472597 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.472814 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.472900 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.473115 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.473201 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.473421 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.473516 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.473719 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.473808 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.474017 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.474103 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.474322 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.474416 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.474621 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.474707 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.474918 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.475006 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.475215 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.475309 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.475519 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.475608 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.475815 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.475903 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.476112 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.476207 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.476432 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.476523 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.476733 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.476831 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.477041 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.477137 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.477341 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.477428 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.477644 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.477735 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.477942 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.478035 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.478259 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.478442 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.478594 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.478757 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.479027 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.479185 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.479330 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.479475 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.479629 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.479785 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.479940 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.480086 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.480365 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.480604 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.480770 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.480917 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.480917 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.481206 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.481206 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.481482 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.481640 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.481794 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.481956 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.482109 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.482263 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.482410 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.482553 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.482719 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.482885 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.483108 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.483820 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.483964 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.484113 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.484251 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.484425 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.484526 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.484610 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.484699 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.484779 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.484857 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.484936 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.485014 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.485099 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.485188 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.485275 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.485355 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.485433 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.485511 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.485589 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.485676 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.485757 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.485933 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.486022 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.486240 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.486327 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.486543 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.486643 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.486840 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.486926 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.487142 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.487243 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.487444 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.487539 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.487743 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.487848 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.488044 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.488147 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.488382 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.488473 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.488669 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.488759 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.488989 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.489124 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.489270 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.489383 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.489568 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.489657 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.489868 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.489964 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.490168 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.490254 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.490469 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.490569 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.490771 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.490871 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.491128 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.491231 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.491389 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.491516 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.491687 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.491832 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.491996 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.492137 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.492295 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.492488 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.492624 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.492808 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.492927 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.493119 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.493251 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.493425 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.493538 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.493735 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.493830 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.494040 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.494127 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.494342 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.494438 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.494651 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.494737 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.494971 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.495057 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.495273 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.495361 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.495570 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.495657 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.495866 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.495971 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.496708 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.496847 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.497016 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.497238 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.497324 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.497546 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.497727 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.497916 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.498004 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.498228 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.498325 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.498527 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.498622 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.498829 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.498917 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.499133 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.499252 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.499459 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.499565 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.499764 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.499860 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.500067 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.500162 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.500391 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.500501 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.500697 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.500791 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.501037 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.501122 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.501337 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.501430 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.501644 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.501728 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.501960 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.502047 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.502265 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.502353 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.502577 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.502662 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.502885 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.502984 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.503193 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.503276 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.503499 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.503651 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.503801 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.503954 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.504092 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.504227 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.504421 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.504554 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.504734 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.504887 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.505023 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.505166 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.505332 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.505471 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.505654 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.505795 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.505968 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.506105 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.506275 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.506418 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.506584 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.506727 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.506888 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.507025 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.507192 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.507329 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.507496 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.507633 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.507801 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.507936 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.508106 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.508252 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.508434 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.508569 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.508744 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.508879 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.509045 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.509200 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.509343 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.509435 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.509637 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.509726 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.509943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.510031 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.510244 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.510341 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.510552 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.510654 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.510860 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.510972 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.511160 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.511247 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.511463 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.511549 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.512305 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.512470 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.512660 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.512750 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.512974 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.513070 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.513279 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.513443 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.513589 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.513721 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.513895 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.514006 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.514205 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.514340 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.514619 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.514714 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.514948 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.515063 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.515262 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.515379 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.515574 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.515692 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.515876 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.516001 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.516287 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.516408 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.516622 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.516709 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.516931 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.517019 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.517238 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.517326 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.517540 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.517627 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.517839 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.517956 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.518146 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.518271 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.518465 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.518584 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.518765 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.518897 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.519064 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.519206 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.519364 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.519511 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.519681 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.519821 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.519980 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.520145 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.520309 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.520524 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.520770 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.520959 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.521083 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.521195 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.521387 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.521494 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.521722 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.521809 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.522043 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.522137 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.522391 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.522483 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.522709 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.522797 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.523028 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.523120 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.523346 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.523448 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.523652 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.523826 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.523963 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.524053 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.524270 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.524401 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.524613 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.524713 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.524932 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.525029 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.525240 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.525329 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.525550 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.525638 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.525850 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.525957 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.526173 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.526294 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.526488 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.526609 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.526799 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.526965 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.527109 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.527287 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.527512 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.527693 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.527914 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.528131 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.528274 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.528452 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.528604 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.528752 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.528897 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.529035 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.529181 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.529324 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.529460 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.529605 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.529743 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.529879 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.530023 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.530165 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.530310 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.530446 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.530582 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.530718 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.530888 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.531044 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.531210 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.531342 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.531478 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.531622 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.531765 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.531910 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.532054 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.532192 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.532371 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.532504 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.532692 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.532817 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.532994 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.533127 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.533315 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.533435 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.533627 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.533724 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.533949 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.534028 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.534267 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.534354 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.534567 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.534672 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.534886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.534974 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.535190 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.535285 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.535489 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.535585 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.535788 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.535876 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.536087 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.536174 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.536447 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.536557 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.536750 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.536838 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.537062 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.537150 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.537364 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.537453 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.537668 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.537756 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.537992 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.538085 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.538303 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.538391 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.538624 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.538731 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.538976 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.539089 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.539252 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.539342 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.539571 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.539669 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.539869 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.539957 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.540168 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.540264 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.540496 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.540575 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.548045 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.548156 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.548236 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.548305 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.548456 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.548541 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.548633 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.548727 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.548808 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.548887 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.548965 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.549043 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.549137 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.549237 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.549326 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.549433 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.549573 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.549722 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.549804 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.549905 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.549996 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.550078 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.550156 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.550234 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.550321 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.550402 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.550547 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.550635 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.550715 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.550795 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.550888 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.550971 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.551057 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.551137 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.551215 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.551293 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.551380 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.551506 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.551593 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.551674 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.551752 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.551831 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.551918 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.551999 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.552078 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.552156 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.552235 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.552381 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.552468 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.552547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.552639 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.552721 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.552801 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.552888 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.552969 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.553047 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.553125 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.553202 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.553279 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.553366 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.553447 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.553526 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.553526 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.553685 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.553685 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.553834 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.553915 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.553993 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.554087 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.554171 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.554251 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.554332 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.554412 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.554497 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.554589 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.554670 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.554757 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.554837 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.554915 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.554915 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.555059 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.555059 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.555209 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.555289 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.555368 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.555465 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.555533 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.555608 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.555696 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.555778 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.555863 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.555974 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.556058 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.556150 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.556247 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.556247 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.556427 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.556427 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.556577 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.556667 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.556756 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.556756 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.556910 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.556998 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.557091 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.557217 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.557338 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.557528 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.557625 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.557834 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.557937 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.558142 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.558229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.558956 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.559056 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.559284 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.559438 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.559607 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.559784 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.559871 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.560022 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.560178 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.560379 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.560517 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.560702 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.560838 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.561019 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.561169 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.561334 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.561485 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.561651 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.561788 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.561959 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.562090 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.562272 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.562402 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.562585 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.562916 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.563027 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.563247 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.563414 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.563551 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.563690 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.563860 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.564006 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.564173 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.564358 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.564535 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.564669 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.564814 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.565115 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.565254 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.565416 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.565565 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.565701 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.565844 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.566083 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.566215 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.566392 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.566523 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.566698 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.566913 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.567057 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.567203 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.567373 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.567505 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.567650 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.567800 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.567937 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.568081 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.568218 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.568394 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.568615 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.568737 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.568923 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.569085 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.569248 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.569501 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.569879 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.570073 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.570162 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.570242 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.570321 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.570401 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.570490 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.570623 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.570946 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.571094 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.571301 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.571390 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.571623 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.571770 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.571920 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.572008 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.572224 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.572345 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.572551 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.572640 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.572859 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.572946 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.573167 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.573268 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.573473 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.573560 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.573773 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.573860 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.574095 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.574222 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.574953 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.575049 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.575262 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.575358 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.575568 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.575671 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.575881 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.575969 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.576182 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.576275 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.576515 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.576606 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.576815 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.576900 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.577116 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.577211 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.577419 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.577559 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.577725 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.577868 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.578013 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.578141 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.578321 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.578455 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.578623 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.578754 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.578923 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.579058 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.579228 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.579360 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.579527 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.579669 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.579816 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.579955 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.580111 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.580248 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.580444 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.580585 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.580723 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.580870 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.581036 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.581159 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.581348 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.581446 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.581649 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.581764 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.581961 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.582062 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.582263 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.582348 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.582570 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.582671 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.582914 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.583006 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.583219 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.583305 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.583533 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.583744 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.583833 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.584079 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.584166 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.584420 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.584528 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.584753 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.584842 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.585084 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.585184 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.585387 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.585489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.585688 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.585936 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.586025 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.586273 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.586360 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.586592 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.586679 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.586898 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.586985 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.587205 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.587302 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.587526 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.587617 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.587836 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.587938 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.588145 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.588242 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.588495 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.588584 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.588808 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.588898 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.589112 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.589207 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.589423 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.589532 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.589751 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.589847 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.590088 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.592586 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.592682 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.592764 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.592843 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.592922 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.593016 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.595279 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.595370 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.595440 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.595507 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.595573 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.595651 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.595719 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.597477 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.597569 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.597650 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.597790 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.597881 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.597962 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.598041 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.598119 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.598199 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.598286 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.598367 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.598445 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.598523 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.598600 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.598678 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.598766 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.598846 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.598924 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.599008 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.599095 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.599174 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.599266 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.599346 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.599425 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.599509 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.599598 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.599755 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.599838 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.599917 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.600003 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.600084 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.600163 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.600249 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.600346 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.600416 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.600482 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.600561 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.600656 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.600738 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.600826 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.600913 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.601000 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.601085 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.601172 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.601253 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.601376 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.601470 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.601552 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.601630 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.601718 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.601804 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.601885 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.601971 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.601971 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.602114 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.602200 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.602280 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.602347 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.602420 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.602486 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.602571 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.602640 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.602704 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.602823 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.602910 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.602998 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.603087 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.603167 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.603245 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.603368 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.603508 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.603667 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.603814 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.603895 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.603965 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.604032 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.604098 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.604173 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.604251 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.604319 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.604409 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.604569 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.604672 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.604872 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.604962 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.605172 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.605262 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.605989 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.606251 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.606349 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.606456 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.606659 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.606750 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.606962 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.607052 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.607264 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.607354 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.607568 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.607668 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.607892 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.607990 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.608220 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.608317 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.608556 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.608665 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.608861 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.608964 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.609166 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.609262 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.609470 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.609565 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.609776 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.609872 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.610080 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.610168 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.610396 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.610479 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.610707 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.610803 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.611015 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.611149 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.611406 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.611543 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.611669 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.611858 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.611994 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.612170 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.612307 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.612493 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.612796 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.612926 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.613102 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.613189 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.613416 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.613505 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.613734 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.613822 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.614056 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.614145 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.614362 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.614451 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.614675 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.614764 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.614988 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.615075 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.615301 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.615396 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.615612 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.615700 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.615919 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.616014 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.616247 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.616384 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.616580 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.616670 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.616888 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.616985 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.617195 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.617292 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.617502 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.617590 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.617807 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.617897 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.618120 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.618213 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.618428 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.618517 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.618736 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.618825 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.619048 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.619145 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.619359 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.619446 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.619674 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.619763 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.619988 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.620077 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.620293 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.620417 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.620634 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.620742 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.620962 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.621084 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.621815 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.622004 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.622137 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.622319 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.622453 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.622662 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.622781 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.622989 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.623113 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.623301 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.623425 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.623658 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.623756 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.624099 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.624207 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.624500 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:25:55.624595 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.624731 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.625078 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.625411 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.625727 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.626041 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.626350 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:25:55.626614 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:25:55.780822 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO dbcounter [None req-200a3208-cd2b-465b-9ed6-5b8f54798d9c None None] Registered counter for database nova_api Aug 31 00:25:55.781111 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO dbcounter [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] Registered counter for database nova_api Aug 31 00:25:55.802082 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_db.sqlalchemy.engines [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:25:55.806061 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG oslo_db.sqlalchemy.engines [None req-200a3208-cd2b-465b-9ed6-5b8f54798d9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112904) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:25:55.809097 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writer thread running {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:25:55.813774 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writer thread running {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:25:55.866461 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.context [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cc00dc75-3ec6-4d28-be0f-5f2a558d3e31(cell1) {{(pid=112905) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 00:25:55.870237 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:55.870724 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:55.871371 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.context [None req-200a3208-cd2b-465b-9ed6-5b8f54798d9c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cc00dc75-3ec6-4d28-be0f-5f2a558d3e31(cell1) {{(pid=112904) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 00:25:55.872556 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:55.873298 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:55.873750 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:55.875168 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG oslo_concurrency.lockutils [None req-200a3208-cd2b-465b-9ed6-5b8f54798d9c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:55.875642 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG oslo_concurrency.lockutils [None req-200a3208-cd2b-465b-9ed6-5b8f54798d9c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:55.875745 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:55.877254 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG oslo_concurrency.lockutils [None req-200a3208-cd2b-465b-9ed6-5b8f54798d9c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:55.877732 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO dbcounter [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] Registered counter for database nova_cell0 Aug 31 00:25:55.877966 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG oslo_concurrency.lockutils [None req-200a3208-cd2b-465b-9ed6-5b8f54798d9c None None] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:25:55.878409 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG oslo_concurrency.lockutils [None req-200a3208-cd2b-465b-9ed6-5b8f54798d9c None None] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:25:55.880382 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG oslo_concurrency.lockutils [None req-200a3208-cd2b-465b-9ed6-5b8f54798d9c None None] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:25:55.881852 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO dbcounter [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] Registered counter for database nova_cell1 Aug 31 00:25:55.882337 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO dbcounter [None req-200a3208-cd2b-465b-9ed6-5b8f54798d9c None None] Registered counter for database nova_cell0 Aug 31 00:25:55.890003 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO dbcounter [None req-200a3208-cd2b-465b-9ed6-5b8f54798d9c None None] Registered counter for database nova_cell1 Aug 31 00:25:55.891172 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_db.sqlalchemy.engines [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:25:55.893512 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_db.sqlalchemy.engines [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:25:55.894601 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG oslo_db.sqlalchemy.engines [None req-200a3208-cd2b-465b-9ed6-5b8f54798d9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112904) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:25:55.896393 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG oslo_db.sqlalchemy.engines [None req-200a3208-cd2b-465b-9ed6-5b8f54798d9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112904) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:25:55.896951 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writer thread running {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:25:55.901568 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writer thread running {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:25:55.905677 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writer thread running {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:25:56.039488 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writer thread running {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:25:56.048650 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO dbcounter [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] Registered counter for database nova_cell0 Aug 31 00:25:56.052268 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO dbcounter [None req-200a3208-cd2b-465b-9ed6-5b8f54798d9c None None] Registered counter for database nova_cell0 Aug 31 00:25:56.055540 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_db.sqlalchemy.engines [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:25:56.059439 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG oslo_db.sqlalchemy.engines [None req-200a3208-cd2b-465b-9ed6-5b8f54798d9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112904) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:25:56.060962 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writer thread running {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:25:56.063867 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writer thread running {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:25:56.473716 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: WARNING keystonemiddleware.auth_token [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:25:56.489164 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: WARNING keystonemiddleware.auth_token [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:25:56.497975 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: WARNING keystonemiddleware.auth_token [None req-200a3208-cd2b-465b-9ed6-5b8f54798d9c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:25:56.505439 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: WARNING keystonemiddleware.auth_token [None req-200a3208-cd2b-465b-9ed6-5b8f54798d9c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:25:56.827878 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: WARNING keystonemiddleware.auth_token [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:25:56.833917 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: WARNING keystonemiddleware.auth_token [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:25:56.839219 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fac514d9c0 pid: 112905 (default app) Aug 31 00:25:56.842244 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:25:56.843456 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] 10.222.0.65 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001756 Aug 31 00:25:56.843868 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 788 bytes} [Wed Aug 31 00:25:56 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:25:56.853155 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: WARNING keystonemiddleware.auth_token [None req-200a3208-cd2b-465b-9ed6-5b8f54798d9c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:25:56.859908 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: WARNING keystonemiddleware.auth_token [None req-200a3208-cd2b-465b-9ed6-5b8f54798d9c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:25:56.865257 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fac514d9c0 pid: 112904 (default app) Aug 31 00:27:26.003615 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:26.005653 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002415 Aug 31 00:27:26.006834 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 2/2] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 00:27:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:26.040142 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writing DB stats nova_api:SELECT=3 {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:26.043424 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writing DB stats nova_cell0:SELECT=3 {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:26.045264 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writing DB stats nova_cell1:SELECT=3 {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:26.047794 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:27.456210 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-7b83f923-9481-49dc-be0d-30f5a85617ca admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:27.518406 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-7b83f923-9481-49dc-be0d-30f5a85617ca admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.497728 Aug 31 00:27:27.522083 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 1/3] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 31 00:27:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:30.464958 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:30.466902 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-e12f0c09-8af3-4429-82e4-3377b5619b5d None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002680 Aug 31 00:27:30.467717 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 3/4] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 00:27:30 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:31.135989 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-4d520280-4d4d-4534-bb15-113724d9ee57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1"}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:31.293145 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-4d520280-4d4d-4534-bb15-113724d9ee57 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.816246 Aug 31 00:27:31.294389 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 2/5] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 00:27:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:27:31.315396 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writing DB stats nova_api:SELECT=3 {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:31.316695 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writing DB stats nova_cell1:SELECT=3 {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:31.317576 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writing DB stats nova_cell0:SELECT=3 {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:31.320926 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:31.570136 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-49ad9e2d-bb82-4115-9ece-6fa8f493f836 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:31.764853 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-49ad9e2d-bb82-4115-9ece-6fa8f493f836 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.458106 Aug 31 00:27:31.765550 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 4/6] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 31 00:27:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:34.400494 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-4d520280-4d4d-4534-bb15-113724d9ee57 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:34.401811 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-4d520280-4d4d-4534-bb15-113724d9ee57 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Aug 31 00:27:34.402863 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 3/7] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 00:27:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:35.349123 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-8ed53fd2-d720-4289-991f-83eb980cb185 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:35.486576 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-8ed53fd2-d720-4289-991f-83eb980cb185 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.074917 Aug 31 00:27:35.487736 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 5/8] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 00:27:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:27:35.503660 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-58e0b1cf-cd65-4c36-99a3-a642bf8a6e83 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:35.616534 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-58e0b1cf-cd65-4c36-99a3-a642bf8a6e83 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118421 Aug 31 00:27:35.617902 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 4/9] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 31 00:27:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:38.351752 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-8ed53fd2-d720-4289-991f-83eb980cb185 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:38.353139 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-8ed53fd2-d720-4289-991f-83eb980cb185 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002630 Aug 31 00:27:38.354014 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 6/10] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 00:27:38 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:38.858914 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-442220d8-ea5a-450f-a806-df1a61ecc537 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "ram": 1024, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:38.969086 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-442220d8-ea5a-450f-a806-df1a61ecc537 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.608176 Aug 31 00:27:38.969571 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 5/11] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 00:27:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:27:38.982003 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-4143e311-1279-42f1-90e0-3902ef1b2c8a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:39.081009 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-4143e311-1279-42f1-90e0-3902ef1b2c8a admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102742 Aug 31 00:27:39.081647 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 7/12] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 31 00:27:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:27:41.618990 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-442220d8-ea5a-450f-a806-df1a61ecc537 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:41.620821 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-442220d8-ea5a-450f-a806-df1a61ecc537 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002059 Aug 31 00:27:41.621332 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 6/13] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 00:27:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:27:42.233086 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-6cffd67f-c36b-4440-a9b9-05681fd26e4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d3", "ram": 2048, "vcpus": 2, "swap": 0, "name": "ds2G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:42.319574 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-6cffd67f-c36b-4440-a9b9-05681fd26e4f admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.684449 Aug 31 00:27:42.321264 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 8/14] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 00:27:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:27:42.336119 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-f88c8639-7770-4f11-96ef-b5846fcbbc1a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:42.450803 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-f88c8639-7770-4f11-96ef-b5846fcbbc1a admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119934 Aug 31 00:27:42.451498 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 7/15] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 31 00:27:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:45.172909 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-6cffd67f-c36b-4440-a9b9-05681fd26e4f admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:45.173919 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-6cffd67f-c36b-4440-a9b9-05681fd26e4f admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 31 00:27:45.174315 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 9/16] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 00:27:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:45.721343 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-5fbd2fdc-910f-48a1-a9e9-f2bfb29f9974 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "swap": 0, "id": "d4", "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "ds4G"}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:45.818202 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-5fbd2fdc-910f-48a1-a9e9-f2bfb29f9974 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.633372 Aug 31 00:27:45.820245 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 8/17] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 00:27:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:27:45.832268 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-3c550b49-ea35-4b2c-ad72-e92f0302c26b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:45.942065 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-3c550b49-ea35-4b2c-ad72-e92f0302c26b admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113607 Aug 31 00:27:45.942582 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 10/18] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 31 00:27:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:48.476218 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-5fbd2fdc-910f-48a1-a9e9-f2bfb29f9974 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:48.478020 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-5fbd2fdc-910f-48a1-a9e9-f2bfb29f9974 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002597 Aug 31 00:27:48.479190 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 9/19] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 00:27:48 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:48.998110 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-876346f3-9b9a-4eaf-bb94-3ffd5a1ba27f admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:49.022859 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-876346f3-9b9a-4eaf-bb94-3ffd5a1ba27f admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.535705 Aug 31 00:27:49.023590 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 11/20] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 31 00:27:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:27:51.506065 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-5fbd2fdc-910f-48a1-a9e9-f2bfb29f9974 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:51.515685 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-5fbd2fdc-910f-48a1-a9e9-f2bfb29f9974 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001792 Aug 31 00:27:51.515685 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 10/21] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 00:27:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:51.963545 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-f0d1c842-31d5-4e88-8004-b6b0db1262d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:52.042381 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-f0d1c842-31d5-4e88-8004-b6b0db1262d4 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.528355 Aug 31 00:27:52.042948 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 12/22] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 00:27:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:27:52.056092 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-64209bc2-8fc4-4b1b-b618-f06043e8c45d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:52.148042 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-64209bc2-8fc4-4b1b-b618-f06043e8c45d admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096432 Aug 31 00:27:52.148750 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 11/23] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 31 00:27:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:54.549000 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-f0d1c842-31d5-4e88-8004-b6b0db1262d4 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:54.549974 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-f0d1c842-31d5-4e88-8004-b6b0db1262d4 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Aug 31 00:27:54.550388 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 13/24] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 00:27:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:54.969962 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-f3ac68ac-ed6d-45d9-a206-793b9a2eaa51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:55.052742 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-f3ac68ac-ed6d-45d9-a206-793b9a2eaa51 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.494718 Aug 31 00:27:55.053303 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 12/25] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 00:27:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:27:55.065851 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-ac5b61be-fdae-4960-bf07-0a0f791d9b70 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:55.139689 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-ac5b61be-fdae-4960-bf07-0a0f791d9b70 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077553 Aug 31 00:27:55.140259 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 14/26] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 31 00:27:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:27:57.602154 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-f3ac68ac-ed6d-45d9-a206-793b9a2eaa51 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:27:57.603177 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-f3ac68ac-ed6d-45d9-a206-793b9a2eaa51 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 31 00:27:57.603579 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 13/27] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 00:27:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:27:58.091960 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-e68d8e0d-ee57-4731-98ef-2d79d798b05d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "disk": 40, "name": "m1.medium"}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:58.172249 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-e68d8e0d-ee57-4731-98ef-2d79d798b05d admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.561573 Aug 31 00:27:58.173086 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 15/28] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 00:27:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:27:58.186852 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-ea2f66eb-2a86-4239-8772-72485ba76027 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:27:58.191632 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:58.283308 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-ea2f66eb-2a86-4239-8772-72485ba76027 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100076 Aug 31 00:27:58.297159 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 14/29] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 31 00:27:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:00.754627 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-e68d8e0d-ee57-4731-98ef-2d79d798b05d admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:00.756685 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-e68d8e0d-ee57-4731-98ef-2d79d798b05d admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001845 Aug 31 00:28:00.757374 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 16/30] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 00:28:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:01.233129 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-d46d59b4-1ff7-4dcf-9839-45383f2d5dd0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "vcpus": 4, "name": "m1.large", "id": "4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:01.312067 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-d46d59b4-1ff7-4dcf-9839-45383f2d5dd0 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.545925 Aug 31 00:28:01.316658 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 15/31] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 00:28:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:28:01.323363 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-2826600f-71f7-4c0b-ad03-e35edd3717e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:01.410768 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-2826600f-71f7-4c0b-ad03-e35edd3717e0 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090963 Aug 31 00:28:01.411456 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 17/32] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 31 00:28:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:28:03.860743 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-d46d59b4-1ff7-4dcf-9839-45383f2d5dd0 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:03.862520 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-d46d59b4-1ff7-4dcf-9839-45383f2d5dd0 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002299 Aug 31 00:28:03.862928 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 16/33] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 00:28:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:04.323089 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-7d76073f-c3e9-4d26-8062-563a87551dc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "id": "5"}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:04.329051 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:04.411945 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-7d76073f-c3e9-4d26-8062-563a87551dc0 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.541542 Aug 31 00:28:04.412541 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 18/34] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 31 00:28:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:28:04.425647 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-cd172739-860b-4f0c-a6fa-72e463ae55de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:04.514164 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-cd172739-860b-4f0c-a6fa-72e463ae55de admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092274 Aug 31 00:28:04.516219 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 17/35] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 31 00:28:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:28:23.804915 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-7d76073f-c3e9-4d26-8062-563a87551dc0 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:23.805972 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-7d76073f-c3e9-4d26-8062-563a87551dc0 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Aug 31 00:28:23.806383 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 00:28:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:23.817892 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:24.255299 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-21b64541-e7b6-42e5-a976-0898fb36a046 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:24.274884 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-21b64541-e7b6-42e5-a976-0898fb36a046 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.461843 Aug 31 00:28:24.275428 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 18/37] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 31 00:28:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:28:25.381389 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-7d76073f-c3e9-4d26-8062-563a87551dc0 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:25.382456 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-7d76073f-c3e9-4d26-8062-563a87551dc0 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001679 Aug 31 00:28:25.382936 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 20/38] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 00:28:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:28:25.915980 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-5f28e5f4-8414-4ac6-9751-a7fa2ea45b8d admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:25.921641 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.wsgi [None req-5f28e5f4-8414-4ac6-9751-a7fa2ea45b8d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-5f28e5f4-8414-4ac6-9751-a7fa2ea45b8d admin admin] Request method failure captured: Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Accept: application/json Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Accept-Encoding: gzip, deflate Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Connection: keep-alive Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Content-Length: 0 Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Host: 10.222.0.65 Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Openstack-Api-Version: compute 2.90 Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Openstack-System-Scope: None Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: User-Agent: python-novaclient Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Auth-Token: gAAAAABjDqsp7vvL2eaRDpDeo_o0r76vCQ4WefVBARC_MYf0ohTAw5o4tEk_C6_z6ZbGK7EMfSJBQAC-e0URXguFlcYhiZpaJb5Pg4QVUr6vbx5wzQBeMhyhikyOYlF22mPoD5bhbpkhdRPkQDNhrzqZ8kwt5tQwajV_YgVk-d0KkrXFELiiT2k Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Domain-Id: None Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Domain-Name: None Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Identity-Status: Confirmed Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Is-Admin-Project: True Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Project-Domain-Id: default Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Project-Domain-Name: Default Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Project-Id: 130b40029b174542ac4b0eacc3caf048 Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Project-Name: admin Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Role: admin,member,reader Aug 31 00:28:25.924886 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Roles: admin,member,reader Aug 31 00:28:25.927245 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/130b40029b174542ac4b0eacc3caf048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/130b40029b174542ac4b0eacc3caf048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/130b40029b174542ac4b0eacc3caf048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_130b40029b174542ac4b0eacc3caf048"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:28:25.927245 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Tenant: admin Aug 31 00:28:25.927245 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Tenant-Id: 130b40029b174542ac4b0eacc3caf048 Aug 31 00:28:25.927245 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Tenant-Name: admin Aug 31 00:28:25.927245 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-User: admin Aug 31 00:28:25.927245 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-User-Domain-Id: default Aug 31 00:28:25.927245 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-User-Domain-Name: Default Aug 31 00:28:25.927245 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-User-Id: 3b2336264fcc4528b59320d71b7da06f Aug 31 00:28:25.927245 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-User-Name: admin Aug 31 00:28:25.927245 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: method: > Aug 31 00:28:25.927245 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: exception: Flavor 42 could not be found. Aug 31 00:28:25.927245 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: action_args: {'id': '42'} Aug 31 00:28:25.927245 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:25.927245 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:25.928375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:28:25.928375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:28:25.928375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:28:25.928375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:28:25.928375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:28:25.928375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:28:25.928375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:28:25.928375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:28:25.928375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:28:25.928375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:25.928375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:28:25.928375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:28:25.928375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 00:28:25.928375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Aug 31 00:28:25.928375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:25.928375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Aug 31 00:28:25.928375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:25.928375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:25.928375 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:25.930016 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:25.930016 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:25.930016 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:25.930016 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:25.930016 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:28:25.930016 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:28:25.930016 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 00:28:25.930016 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Aug 31 00:28:25.930016 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:25.930016 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Aug 31 00:28:25.930016 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:25.930016 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:25.930016 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:25.930016 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:25.930016 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:25.930016 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 00:28:25.930016 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Aug 31 00:28:25.930016 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-5f28e5f4-8414-4ac6-9751-a7fa2ea45b8d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112904) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:25.931330 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-5f28e5f4-8414-4ac6-9751-a7fa2ea45b8d admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.403480 Aug 31 00:28:25.931330 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 19/39] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 31 00:28:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:25.936846 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-3fefe7c0-5989-48f0-b426-ae97aee5cb63 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:25.961039 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-3fefe7c0-5989-48f0-b426-ae97aee5cb63 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027654 Aug 31 00:28:25.965577 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 21/40] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 31 00:28:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:28:25.971527 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-73a6599e-6324-4c38-bb90-eb606fc89927 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:25.995299 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-73a6599e-6324-4c38-bb90-eb606fc89927 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027439 Aug 31 00:28:25.995849 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 20/41] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 31 00:28:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:28:26.006063 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-d21ec248-efc5-4158-b233-92f7217950e2 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:26.012069 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.wsgi [None req-d21ec248-efc5-4158-b233-92f7217950e2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-d21ec248-efc5-4158-b233-92f7217950e2 admin admin] Request method failure captured: Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Accept: application/json Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Accept-Encoding: gzip, deflate Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Connection: keep-alive Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Content-Length: 0 Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Host: 10.222.0.65 Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Openstack-Api-Version: compute 2.90 Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Openstack-System-Scope: None Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: User-Agent: python-novaclient Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Auth-Token: gAAAAABjDqsp7vvL2eaRDpDeo_o0r76vCQ4WefVBARC_MYf0ohTAw5o4tEk_C6_z6ZbGK7EMfSJBQAC-e0URXguFlcYhiZpaJb5Pg4QVUr6vbx5wzQBeMhyhikyOYlF22mPoD5bhbpkhdRPkQDNhrzqZ8kwt5tQwajV_YgVk-d0KkrXFELiiT2k Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Domain-Id: None Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Domain-Name: None Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Identity-Status: Confirmed Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Is-Admin-Project: True Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Project-Domain-Id: default Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Project-Domain-Name: Default Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Project-Id: 130b40029b174542ac4b0eacc3caf048 Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Project-Name: admin Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Role: admin,member,reader Aug 31 00:28:26.015489 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Roles: admin,member,reader Aug 31 00:28:26.017214 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/130b40029b174542ac4b0eacc3caf048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/130b40029b174542ac4b0eacc3caf048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/130b40029b174542ac4b0eacc3caf048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_130b40029b174542ac4b0eacc3caf048"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:28:26.017214 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Tenant: admin Aug 31 00:28:26.017214 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Tenant-Id: 130b40029b174542ac4b0eacc3caf048 Aug 31 00:28:26.017214 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Tenant-Name: admin Aug 31 00:28:26.017214 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-User: admin Aug 31 00:28:26.017214 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-User-Domain-Id: default Aug 31 00:28:26.017214 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-User-Domain-Name: Default Aug 31 00:28:26.017214 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-User-Id: 3b2336264fcc4528b59320d71b7da06f Aug 31 00:28:26.017214 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-User-Name: admin Aug 31 00:28:26.017214 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: method: > Aug 31 00:28:26.017214 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: exception: Flavor 42 could not be found. Aug 31 00:28:26.017214 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: action_args: {'id': '42'} Aug 31 00:28:26.017214 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:26.017214 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:26.018151 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:28:26.018151 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:28:26.018151 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:28:26.018151 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:28:26.018151 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:28:26.018151 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:28:26.018151 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:28:26.018151 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:28:26.018151 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:28:26.018151 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:26.018151 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:28:26.018151 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:28:26.018151 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 00:28:26.018151 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Aug 31 00:28:26.018151 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:26.018151 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Aug 31 00:28:26.018151 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:26.018151 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:26.018151 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:26.019275 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:26.019275 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:26.019275 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:26.019275 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:26.019275 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:28:26.019275 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:28:26.019275 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 00:28:26.019275 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Aug 31 00:28:26.019275 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:26.019275 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Aug 31 00:28:26.019275 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:26.019275 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:26.019275 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:26.019275 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:26.019275 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:26.019275 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 00:28:26.019275 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Aug 31 00:28:26.019275 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-d21ec248-efc5-4158-b233-92f7217950e2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:26.028552 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-d21ec248-efc5-4158-b233-92f7217950e2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014995 Aug 31 00:28:26.028552 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 22/42] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 31 00:28:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:27.018710 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-73a6599e-6324-4c38-bb90-eb606fc89927 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:27.019869 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-73a6599e-6324-4c38-bb90-eb606fc89927 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 31 00:28:27.020535 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 21/43] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 00:28:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:27.580618 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-84ffaeab-c960-4695-933c-b7eda9c2bfb5 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:27.587659 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.wsgi [None req-84ffaeab-c960-4695-933c-b7eda9c2bfb5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-84ffaeab-c960-4695-933c-b7eda9c2bfb5 admin admin] Request method failure captured: Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Accept: application/json Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Accept-Encoding: gzip, deflate Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Connection: keep-alive Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Content-Length: 0 Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Host: 10.222.0.65 Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Openstack-Api-Version: compute 2.90 Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Openstack-System-Scope: None Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: User-Agent: python-novaclient Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Auth-Token: gAAAAABjDqsqp8bm9w0ZJZL0Xou_OqgFcZzXIIiXRzBuOXlqGMaXnhzHmPzbT8-9ng4kRJa7-tZR1FjBt68SdSmBtHbaaqwWirUPnckqXYdbD6NX6zUjG3b6sWy9OvHcSLS9LI4-D3iQPGo7KGyWrcFWZiD0U9cXmIaGU1nWD6ucPlTyG9q4nyY Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Domain-Id: None Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Domain-Name: None Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Identity-Status: Confirmed Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Is-Admin-Project: True Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Project-Domain-Id: default Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Project-Domain-Name: Default Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Project-Id: 130b40029b174542ac4b0eacc3caf048 Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Project-Name: admin Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Role: admin,member,reader Aug 31 00:28:27.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Roles: admin,member,reader Aug 31 00:28:27.590774 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/130b40029b174542ac4b0eacc3caf048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/130b40029b174542ac4b0eacc3caf048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/130b40029b174542ac4b0eacc3caf048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_130b40029b174542ac4b0eacc3caf048"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:28:27.590774 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Tenant: admin Aug 31 00:28:27.590774 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Tenant-Id: 130b40029b174542ac4b0eacc3caf048 Aug 31 00:28:27.590774 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Tenant-Name: admin Aug 31 00:28:27.590774 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-User: admin Aug 31 00:28:27.590774 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-User-Domain-Id: default Aug 31 00:28:27.590774 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-User-Domain-Name: Default Aug 31 00:28:27.590774 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-User-Id: 3b2336264fcc4528b59320d71b7da06f Aug 31 00:28:27.590774 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-User-Name: admin Aug 31 00:28:27.590774 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: method: > Aug 31 00:28:27.590774 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: exception: Flavor 84 could not be found. Aug 31 00:28:27.590774 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: action_args: {'id': '84'} Aug 31 00:28:27.590774 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:27.590774 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:27.591845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:28:27.591845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:28:27.591845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:28:27.591845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:28:27.591845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:28:27.591845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:28:27.591845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:28:27.591845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:28:27.591845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:28:27.591845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:27.591845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:28:27.591845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:28:27.591845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 00:28:27.591845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Aug 31 00:28:27.591845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:27.591845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Aug 31 00:28:27.591845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:27.591845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:27.591845 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:27.593229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:27.593229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:27.593229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:27.593229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:27.593229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:28:27.593229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:28:27.593229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 00:28:27.593229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Aug 31 00:28:27.593229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:27.593229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Aug 31 00:28:27.593229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:27.593229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:27.593229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:27.593229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:27.593229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:27.593229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 00:28:27.593229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Aug 31 00:28:27.593229 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-84ffaeab-c960-4695-933c-b7eda9c2bfb5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:27.594444 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-84ffaeab-c960-4695-933c-b7eda9c2bfb5 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.432125 Aug 31 00:28:27.594444 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 23/44] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 31 00:28:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:27.601650 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-f993d590-bcd6-44df-88b8-25ac646a37bd admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:27.617397 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-f993d590-bcd6-44df-88b8-25ac646a37bd admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020198 Aug 31 00:28:27.617955 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 22/45] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 31 00:28:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:28:27.627562 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-88c5265b-935a-4614-a714-e8d0e21367c0 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:27.642903 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-88c5265b-935a-4614-a714-e8d0e21367c0 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018810 Aug 31 00:28:27.643444 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 24/46] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 31 00:28:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:28:27.656564 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-6e4e7290-a374-44b9-85ee-c95e4aec3a61 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:27.662665 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.wsgi [None req-6e4e7290-a374-44b9-85ee-c95e4aec3a61 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-6e4e7290-a374-44b9-85ee-c95e4aec3a61 admin admin] Request method failure captured: Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Accept: application/json Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Accept-Encoding: gzip, deflate Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Connection: keep-alive Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Content-Length: 0 Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Host: 10.222.0.65 Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Openstack-Api-Version: compute 2.90 Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Openstack-System-Scope: None Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: User-Agent: python-novaclient Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Auth-Token: gAAAAABjDqsqp8bm9w0ZJZL0Xou_OqgFcZzXIIiXRzBuOXlqGMaXnhzHmPzbT8-9ng4kRJa7-tZR1FjBt68SdSmBtHbaaqwWirUPnckqXYdbD6NX6zUjG3b6sWy9OvHcSLS9LI4-D3iQPGo7KGyWrcFWZiD0U9cXmIaGU1nWD6ucPlTyG9q4nyY Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Domain-Id: None Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Domain-Name: None Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Identity-Status: Confirmed Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Is-Admin-Project: True Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Project-Domain-Id: default Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Project-Domain-Name: Default Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Project-Id: 130b40029b174542ac4b0eacc3caf048 Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Project-Name: admin Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Role: admin,member,reader Aug 31 00:28:27.664196 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Roles: admin,member,reader Aug 31 00:28:27.666060 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/130b40029b174542ac4b0eacc3caf048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/130b40029b174542ac4b0eacc3caf048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/130b40029b174542ac4b0eacc3caf048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_130b40029b174542ac4b0eacc3caf048"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:28:27.666060 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Tenant: admin Aug 31 00:28:27.666060 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Tenant-Id: 130b40029b174542ac4b0eacc3caf048 Aug 31 00:28:27.666060 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Tenant-Name: admin Aug 31 00:28:27.666060 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-User: admin Aug 31 00:28:27.666060 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-User-Domain-Id: default Aug 31 00:28:27.666060 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-User-Domain-Name: Default Aug 31 00:28:27.666060 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-User-Id: 3b2336264fcc4528b59320d71b7da06f Aug 31 00:28:27.666060 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-User-Name: admin Aug 31 00:28:27.666060 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: method: > Aug 31 00:28:27.666060 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: exception: Flavor 84 could not be found. Aug 31 00:28:27.666060 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: action_args: {'id': '84'} Aug 31 00:28:27.666060 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:27.666060 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:27.666943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:28:27.666943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:28:27.666943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:28:27.666943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:28:27.666943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:28:27.666943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:28:27.666943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:28:27.666943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:28:27.666943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:28:27.666943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:27.666943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:28:27.666943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:28:27.666943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 00:28:27.666943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Aug 31 00:28:27.666943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:27.666943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Aug 31 00:28:27.666943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:27.666943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:27.666943 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:27.668476 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:27.668476 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:27.668476 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:27.668476 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:27.668476 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:28:27.668476 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:28:27.668476 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 00:28:27.668476 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Aug 31 00:28:27.668476 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:27.668476 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Aug 31 00:28:27.668476 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:27.668476 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:27.668476 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:27.668476 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:27.668476 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:27.668476 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 00:28:27.668476 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Aug 31 00:28:27.668476 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-6e4e7290-a374-44b9-85ee-c95e4aec3a61 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112904) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:27.669655 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-6e4e7290-a374-44b9-85ee-c95e4aec3a61 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012940 Aug 31 00:28:27.669655 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 23/47] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 31 00:28:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 00:28:28.870642 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-88c5265b-935a-4614-a714-e8d0e21367c0 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:28.871933 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-88c5265b-935a-4614-a714-e8d0e21367c0 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 31 00:28:28.872059 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 25/48] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 00:28:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:29.525575 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-2f28fdb1-5c3a-445b-80c9-9c6c79bd0314 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:29.533374 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.wsgi [None req-2f28fdb1-5c3a-445b-80c9-9c6c79bd0314 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-2f28fdb1-5c3a-445b-80c9-9c6c79bd0314 admin admin] Request method failure captured: Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Accept: application/json Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Accept-Encoding: gzip, deflate Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Connection: keep-alive Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Content-Length: 0 Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Host: 10.222.0.65 Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Openstack-Api-Version: compute 2.90 Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Openstack-System-Scope: None Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: User-Agent: python-novaclient Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Auth-Token: gAAAAABjDqssKvnmHwKL4KiwEL3tP2kvJZ9pGpldkjjAeMHFo2HsDeFA9sBT8U6l7-iR6io1N97AMlGt3p27w-3DKKVe4-nhg3hUKelygTpwLBccgMcz0xjB7tWlIsruHkfxVuweUQYblqv--A8hNWM2HCicXHboJIyECc9dv4u_mSdpMax3c90 Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Domain-Id: None Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Domain-Name: None Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Identity-Status: Confirmed Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Is-Admin-Project: True Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Project-Domain-Id: default Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Project-Domain-Name: Default Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Project-Id: 130b40029b174542ac4b0eacc3caf048 Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Project-Name: admin Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Role: admin,member,reader Aug 31 00:28:29.535558 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Roles: admin,member,reader Aug 31 00:28:29.537164 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/130b40029b174542ac4b0eacc3caf048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/130b40029b174542ac4b0eacc3caf048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/130b40029b174542ac4b0eacc3caf048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_130b40029b174542ac4b0eacc3caf048"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:28:29.537164 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Tenant: admin Aug 31 00:28:29.537164 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Tenant-Id: 130b40029b174542ac4b0eacc3caf048 Aug 31 00:28:29.537164 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-Tenant-Name: admin Aug 31 00:28:29.537164 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-User: admin Aug 31 00:28:29.537164 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-User-Domain-Id: default Aug 31 00:28:29.537164 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-User-Domain-Name: Default Aug 31 00:28:29.537164 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-User-Id: 3b2336264fcc4528b59320d71b7da06f Aug 31 00:28:29.537164 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: X-User-Name: admin Aug 31 00:28:29.537164 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: method: > Aug 31 00:28:29.537164 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: exception: Flavor 451 could not be found. Aug 31 00:28:29.537164 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: action_args: {'id': '451'} Aug 31 00:28:29.537164 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:29.537164 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:29.538333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:28:29.538333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:28:29.538333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:28:29.538333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:28:29.538333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:28:29.538333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:28:29.538333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:28:29.538333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:28:29.538333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:28:29.538333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:29.538333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:28:29.538333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:28:29.538333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 00:28:29.538333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Aug 31 00:28:29.538333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:29.538333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Aug 31 00:28:29.538333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:29.538333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:29.538333 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:29.540114 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:29.540114 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:29.540114 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:29.540114 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:29.540114 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:28:29.540114 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:28:29.540114 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 00:28:29.540114 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Aug 31 00:28:29.540114 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:29.540114 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Aug 31 00:28:29.540114 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:29.540114 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:29.540114 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:29.540114 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:29.540114 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:29.540114 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 00:28:29.540114 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Aug 31 00:28:29.540114 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-2f28fdb1-5c3a-445b-80c9-9c6c79bd0314 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112904) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:29.542207 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-2f28fdb1-5c3a-445b-80c9-9c6c79bd0314 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.510414 Aug 31 00:28:29.542207 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 24/49] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 31 00:28:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 512 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:29.550476 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-e7476ec8-7c62-4dfd-95d7-e575b36c1aca admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:29.567178 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-e7476ec8-7c62-4dfd-95d7-e575b36c1aca admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020352 Aug 31 00:28:29.567898 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 26/50] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 31 00:28:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:28:29.584861 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-84e3dafe-6abc-42a4-823b-6bf04f10bdfa admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:29.601538 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-84e3dafe-6abc-42a4-823b-6bf04f10bdfa admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020374 Aug 31 00:28:29.602113 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 25/51] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 31 00:28:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:28:29.619101 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-191cdc47-4126-49f1-9ee3-5809b0779579 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:29.625981 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.wsgi [None req-191cdc47-4126-49f1-9ee3-5809b0779579 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-191cdc47-4126-49f1-9ee3-5809b0779579 admin admin] Request method failure captured: Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Accept: application/json Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Accept-Encoding: gzip, deflate Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Connection: keep-alive Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Content-Length: 0 Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Host: 10.222.0.65 Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Openstack-Api-Version: compute 2.90 Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Openstack-System-Scope: None Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: User-Agent: python-novaclient Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Auth-Token: gAAAAABjDqssKvnmHwKL4KiwEL3tP2kvJZ9pGpldkjjAeMHFo2HsDeFA9sBT8U6l7-iR6io1N97AMlGt3p27w-3DKKVe4-nhg3hUKelygTpwLBccgMcz0xjB7tWlIsruHkfxVuweUQYblqv--A8hNWM2HCicXHboJIyECc9dv4u_mSdpMax3c90 Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Domain-Id: None Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Domain-Name: None Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Identity-Status: Confirmed Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Is-Admin-Project: True Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Project-Domain-Id: default Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Project-Domain-Name: Default Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Project-Id: 130b40029b174542ac4b0eacc3caf048 Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Project-Name: admin Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Role: admin,member,reader Aug 31 00:28:29.627547 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Roles: admin,member,reader Aug 31 00:28:29.630819 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/130b40029b174542ac4b0eacc3caf048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/130b40029b174542ac4b0eacc3caf048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/130b40029b174542ac4b0eacc3caf048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_130b40029b174542ac4b0eacc3caf048"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:28:29.630819 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Tenant: admin Aug 31 00:28:29.630819 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Tenant-Id: 130b40029b174542ac4b0eacc3caf048 Aug 31 00:28:29.630819 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-Tenant-Name: admin Aug 31 00:28:29.630819 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-User: admin Aug 31 00:28:29.630819 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-User-Domain-Id: default Aug 31 00:28:29.630819 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-User-Domain-Name: Default Aug 31 00:28:29.630819 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-User-Id: 3b2336264fcc4528b59320d71b7da06f Aug 31 00:28:29.630819 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: X-User-Name: admin Aug 31 00:28:29.630819 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: method: > Aug 31 00:28:29.630819 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: exception: Flavor 451 could not be found. Aug 31 00:28:29.630819 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: action_args: {'id': '451'} Aug 31 00:28:29.630819 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:28:29.630819 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:29.634071 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 00:28:29.634071 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 00:28:29.634071 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 00:28:29.634071 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 00:28:29.634071 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:28:29.634071 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:28:29.634071 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 00:28:29.634071 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 00:28:29.634071 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 00:28:29.634071 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:29.634071 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 00:28:29.634071 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 00:28:29.634071 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 00:28:29.634071 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Aug 31 00:28:29.634071 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:29.634071 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Aug 31 00:28:29.634071 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:29.634071 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:29.634071 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:29.637194 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:28:29.637194 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:28:29.637194 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:28:29.637194 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:28:29.637194 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 00:28:29.637194 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:28:29.637194 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 00:28:29.637194 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Aug 31 00:28:29.637194 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:28:29.637194 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Aug 31 00:28:29.637194 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:28:29.637194 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:28:29.637194 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:28:29.637194 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:28:29.637194 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:28:29.637194 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 00:28:29.637194 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Aug 31 00:28:29.637194 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-191cdc47-4126-49f1-9ee3-5809b0779579 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:28:29.639197 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-191cdc47-4126-49f1-9ee3-5809b0779579 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013747 Aug 31 00:28:29.639197 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 27/52] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 31 00:28:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:30.682641 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-84e3dafe-6abc-42a4-823b-6bf04f10bdfa admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:30.684264 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-84e3dafe-6abc-42a4-823b-6bf04f10bdfa admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002363 Aug 31 00:28:30.684962 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 26/53] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 00:28:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:28:31.302474 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-a4951bf5-6f4f-461d-aa93-b59bff98e4d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:31.600986 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-a4951bf5-6f4f-461d-aa93-b59bff98e4d8 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.774219 Aug 31 00:28:31.608677 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 28/54] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 31 00:28:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:28:32.623115 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-84e3dafe-6abc-42a4-823b-6bf04f10bdfa admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:32.624342 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-84e3dafe-6abc-42a4-823b-6bf04f10bdfa admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001659 Aug 31 00:28:32.624786 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 27/55] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 00:28:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:28:33.223839 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-9023301c-a31f-49f6-9d8a-4ab4b0aaa680 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:33.449563 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-9023301c-a31f-49f6-9d8a-4ab4b0aaa680 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.683047 Aug 31 00:28:33.450030 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 29/56] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 31 00:28:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:28:34.486617 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-84e3dafe-6abc-42a4-823b-6bf04f10bdfa admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:34.487811 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-84e3dafe-6abc-42a4-823b-6bf04f10bdfa admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001958 Aug 31 00:28:34.488912 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 28/57] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 00:28:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:28:35.079172 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-24851e61-3622-4cc0-8200-714a3c21ab9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:35.200025 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-24851e61-3622-4cc0-8200-714a3c21ab9a admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.567572 Aug 31 00:28:35.200539 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 30/58] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 31 00:28:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:28:36.214782 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-84e3dafe-6abc-42a4-823b-6bf04f10bdfa admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:36.216455 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-84e3dafe-6abc-42a4-823b-6bf04f10bdfa admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002384 Aug 31 00:28:36.217163 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 29/59] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 00:28:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:36.797064 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-27d30530-3438-45cb-b8bf-c149a9e16760 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:28:36.907269 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-27d30530-3438-45cb-b8bf-c149a9e16760 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.545894 Aug 31 00:28:36.907743 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 31/60] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 31 00:28:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:28:37.907959 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-84e3dafe-6abc-42a4-823b-6bf04f10bdfa admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:37.909054 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-84e3dafe-6abc-42a4-823b-6bf04f10bdfa admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Aug 31 00:28:37.909452 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 30/61] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 00:28:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:28:38.474393 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-5508b88c-5ca5-4bd3-ac92-cd3dab23f4f5 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:28:38.495955 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-5508b88c-5ca5-4bd3-ac92-cd3dab23f4f5 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.449024 Aug 31 00:28:38.496540 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 32/62] 10.222.0.65 () {60 vars in 1202 bytes} [Wed Aug 31 00:28:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:29:34.562676 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-84e3dafe-6abc-42a4-823b-6bf04f10bdfa admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:34.564245 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-84e3dafe-6abc-42a4-823b-6bf04f10bdfa admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002006 Aug 31 00:29:34.564692 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 31/63] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 31 00:29:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:29:34.575691 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:34.980419 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-f2d5ee64-b0f0-4379-8884-c8b45b57f9ba admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:35.002408 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-f2d5ee64-b0f0-4379-8884-c8b45b57f9ba admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.431180 Aug 31 00:29:35.003008 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 33/64] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 31 00:29:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:29:35.023985 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writing DB stats nova_api:SELECT=14 {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:35.027819 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-93353d2f-22d4-4031-b304-70625f0c5abb admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:35.036180 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-93353d2f-22d4-4031-b304-70625f0c5abb admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013592 Aug 31 00:29:35.041522 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 32/65] 10.222.0.65 () {60 vars in 1283 bytes} [Wed Aug 31 00:29:35 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:35.049922 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-573e517a-20d9-43d7-9248-6d45a15a614d admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:35.057933 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-573e517a-20d9-43d7-9248-6d45a15a614d admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012635 Aug 31 00:29:35.058468 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 34/66] 10.222.0.65 () {60 vars in 1286 bytes} [Wed Aug 31 00:29:35 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:35.070765 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-49162951-e367-4956-b761-93115646a8f7 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:35.079396 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-49162951-e367-4956-b761-93115646a8f7 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011949 Aug 31 00:29:35.080240 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 33/67] 10.222.0.65 () {60 vars in 1286 bytes} [Wed Aug 31 00:29:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:29:35.092276 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-56ede225-ed18-41c0-a9f5-25293c225cc2 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:29:35.100887 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-56ede225-ed18-41c0-a9f5-25293c225cc2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012352 Aug 31 00:29:35.101414 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 35/68] 10.222.0.65 () {60 vars in 1283 bytes} [Wed Aug 31 00:29:35 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:32:48.228742 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-49162951-e367-4956-b761-93115646a8f7 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:32:48.229791 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-49162951-e367-4956-b761-93115646a8f7 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 31 00:32:48.230187 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 34/69] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 00:32:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:32:48.371503 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writing DB stats nova_api:SELECT=6 {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:48.533150 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-b33e4685-f335-4bcc-ae8e-00d206814312 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:32:48.536691 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-b33e4685-f335-4bcc-ae8e-00d206814312 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:32:48.537195 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-b33e4685-f335-4bcc-ae8e-00d206814312 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:32:48.537633 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-b33e4685-f335-4bcc-ae8e-00d206814312 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:32:48.539509 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-b33e4685-f335-4bcc-ae8e-00d206814312 admin admin] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:32:48.540318 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-b33e4685-f335-4bcc-ae8e-00d206814312 admin admin] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:32:48.540852 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-b33e4685-f335-4bcc-ae8e-00d206814312 admin admin] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:32:48.575417 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-b33e4685-f335-4bcc-ae8e-00d206814312 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.205431 Aug 31 00:32:48.575979 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 36/70] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 31 00:32:48 2022] GET /compute/v2.1/os-services => generated 791 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:32:49.410662 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-49162951-e367-4956-b761-93115646a8f7 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:32:49.411680 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-49162951-e367-4956-b761-93115646a8f7 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 31 00:32:49.412075 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 35/71] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 00:32:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:32:49.607637 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-e385643f-b428-411a-9027-3ae7bff45f9f admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:32:49.611222 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e385643f-b428-411a-9027-3ae7bff45f9f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:32:49.611693 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e385643f-b428-411a-9027-3ae7bff45f9f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:32:49.612115 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e385643f-b428-411a-9027-3ae7bff45f9f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:32:49.612904 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e385643f-b428-411a-9027-3ae7bff45f9f admin admin] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:32:49.613341 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e385643f-b428-411a-9027-3ae7bff45f9f admin admin] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:32:49.613749 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e385643f-b428-411a-9027-3ae7bff45f9f admin admin] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:32:49.633780 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-e385643f-b428-411a-9027-3ae7bff45f9f admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076530 Aug 31 00:32:49.634345 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 37/72] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 31 00:32:49 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:33:00.876679 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-49162951-e367-4956-b761-93115646a8f7 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:00.877784 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-49162951-e367-4956-b761-93115646a8f7 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 31 00:33:00.878100 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 36/73] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 00:33:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:33:01.022393 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writing DB stats nova_cell0:SELECT=4 {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:33:01.023136 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writing DB stats nova_cell1:SELECT=4 {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:33:01.023751 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writing DB stats nova_api:SELECT=8 {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:33:01.072991 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-e1611c3c-d5a8-42d7-a6de-756a3a9c7745 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:01.076468 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e1611c3c-d5a8-42d7-a6de-756a3a9c7745 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:01.076959 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e1611c3c-d5a8-42d7-a6de-756a3a9c7745 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:01.077389 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e1611c3c-d5a8-42d7-a6de-756a3a9c7745 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:01.078110 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e1611c3c-d5a8-42d7-a6de-756a3a9c7745 admin admin] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:01.078586 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e1611c3c-d5a8-42d7-a6de-756a3a9c7745 admin admin] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:01.079004 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e1611c3c-d5a8-42d7-a6de-756a3a9c7745 admin admin] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:01.106017 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-e1611c3c-d5a8-42d7-a6de-756a3a9c7745 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088490 Aug 31 00:33:01.106502 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 38/74] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 31 00:33:01 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:33:01.941663 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-49162951-e367-4956-b761-93115646a8f7 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:01.942674 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-49162951-e367-4956-b761-93115646a8f7 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 31 00:33:01.943072 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 37/75] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 31 00:33:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:33:02.149247 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-babd3846-45ca-441f-9b05-13f92acc7072 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:33:02.152649 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-babd3846-45ca-441f-9b05-13f92acc7072 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:02.153223 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-babd3846-45ca-441f-9b05-13f92acc7072 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:02.153559 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-babd3846-45ca-441f-9b05-13f92acc7072 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:02.154290 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-babd3846-45ca-441f-9b05-13f92acc7072 admin admin] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:33:02.154990 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-babd3846-45ca-441f-9b05-13f92acc7072 admin admin] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:33:02.155414 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-babd3846-45ca-441f-9b05-13f92acc7072 admin admin] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:33:02.179088 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-babd3846-45ca-441f-9b05-13f92acc7072 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091489 Aug 31 00:33:02.179673 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 39/76] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 31 00:33:02 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:34:02.112458 dv-cinder-852211-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 00:34:02.113177 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: Wed Aug 31 00:34:02 2022 - graceful shutdown triggered... Aug 31 00:34:02.113665 dv-cinder-852211-6-iscsi devstack@n-api.service[112904]: Gracefully killing worker 1 (pid: 112904)... Aug 31 00:34:02.114362 dv-cinder-852211-6-iscsi devstack@n-api.service[112905]: Gracefully killing worker 2 (pid: 112905)... Aug 31 00:34:03.114335 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: worker 1 buried after 1 seconds Aug 31 00:34:03.114910 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: worker 2 buried after 1 seconds Aug 31 00:34:03.114910 dv-cinder-852211-6-iscsi devstack@n-api.service[112903]: goodbye to uWSGI. Aug 31 00:34:03.115937 dv-cinder-852211-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 00:34:03.116561 dv-cinder-852211-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 00:34:03.119582 dv-cinder-852211-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 00:34:03.131074 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 00:34:03.133113 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 00:34:03 2022] *** Aug 31 00:34:03.133113 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 00:34:03.133113 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 00:34:03.133113 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: nodename: dv-cinder-852211-6-iscsi Aug 31 00:34:03.133113 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: machine: x86_64 Aug 31 00:34:03.133113 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: clock source: unix Aug 31 00:34:03.133113 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: pcre jit disabled Aug 31 00:34:03.133113 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: detected number of CPU cores: 4 Aug 31 00:34:03.133113 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: current working directory: / Aug 31 00:34:03.133113 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: detected binary path: /usr/bin/uwsgi-core Aug 31 00:34:03.133113 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: your processes number limit is 47680 Aug 31 00:34:03.133967 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: your memory page size is 4096 bytes Aug 31 00:34:03.133967 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: detected max file descriptor number: 2048 Aug 31 00:34:03.133967 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: lock engine: pthread robust mutexes Aug 31 00:34:03.133967 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: thunder lock: enabled Aug 31 00:34:03.133967 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 00:34:03.133967 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 00:34:03.174521 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: Python main interpreter initialized at 0x5594a435b9c0 Aug 31 00:34:03.174521 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: python threads support enabled Aug 31 00:34:03.174521 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: your server socket listen backlog is limited to 100 connections Aug 31 00:34:03.174521 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: your mercy for graceful operations on workers is 90 seconds Aug 31 00:34:03.174980 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 00:34:03.174980 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: *** Operational MODE: preforking *** Aug 31 00:34:03.175266 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: *** uWSGI is running in multiple interpreter mode *** Aug 31 00:34:03.175266 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: spawned uWSGI master process (pid: 128037) Aug 31 00:34:03.175445 dv-cinder-852211-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 00:34:03.178295 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: spawned uWSGI worker 1 (pid: 128048, cores: 1) Aug 31 00:34:03.178295 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: spawned uWSGI worker 2 (pid: 128049, cores: 1) Aug 31 00:34:03.178295 dv-cinder-852211-6-iscsi devstack@n-api.service[128037]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 00:34:03.845833 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 00:34:03.846454 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 00:34:05.014963 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:34:05.014963 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: from cryptography.utils import int_from_bytes Aug 31 00:34:05.015709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:34:05.015709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: from cryptography.utils import int_from_bytes Aug 31 00:34:05.016097 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:34:05.016097 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: from cryptography.utils import int_from_bytes Aug 31 00:34:05.016243 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:34:05.016243 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: from cryptography.utils import int_from_bytes Aug 31 00:34:07.431203 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:34:07.431873 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:34:07.431984 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:34:07.432367 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:34:07.432620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:34:07.433014 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.433967 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.434269 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.434598 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.435080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.435400 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.435730 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.435909 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:34:07.436361 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.436453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:34:07.436527 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.436739 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:34:07.436840 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.437083 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.437187 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:34:07.437359 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:34:07.437476 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-6-iscsi {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.437754 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.437867 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.438042 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.438197 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.438378 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.438667 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.438794 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.438996 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.439163 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.439318 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.439497 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.439658 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.439812 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.439935 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.440124 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.440480 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.440712 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.440938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.441251 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.441573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.441916 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.442157 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.442523 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.442678 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.442835 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.443038 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.443222 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.443379 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-6-iscsi {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.443551 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.443861 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.444121 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.444345 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.444553 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-6-iscsi {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.444808 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.445053 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.445268 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.445484 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.445700 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.445907 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.446125 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.446347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.446556 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.446774 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.446774 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.447163 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.447377 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.447529 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.447681 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.447912 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.448069 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.448217 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.448419 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.448609 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.448755 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.449066 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.449066 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.449411 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.449411 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.449686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.449802 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.449957 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.450075 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.450190 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.450315 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.450450 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.450584 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.450584 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.450794 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-6-iscsi {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.450913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.451705 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.451826 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.451944 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.452060 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.452177 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.452295 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.453599 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.453765 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.453927 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.454074 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.454229 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.454380 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.454380 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.454671 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.455621 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.455784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.455952 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.456098 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.456240 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.456457 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.456618 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.456821 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.456967 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.457109 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.457263 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.457404 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.457546 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.457701 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.457896 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.458043 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.458195 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.458344 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.458494 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.458687 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.458887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.459039 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.459186 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.459339 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.459339 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.459622 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.459807 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.459949 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.460089 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.460236 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.460413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.460570 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.460719 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.460991 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.461159 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.461947 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.462112 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.462265 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.462416 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.462568 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.462831 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.463039 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.463239 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.463387 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.463529 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.463676 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.463826 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.464021 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.464177 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.464334 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.465060 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.465223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.465373 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.465551 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.465815 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.466175 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.466337 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.466480 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.466620 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.466771 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.466933 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.467075 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.467270 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.467418 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.467576 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.467717 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.467868 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.468009 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.468185 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.468384 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.468619 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.468770 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.468912 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.469109 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.469264 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.469413 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.469566 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.469707 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.469854 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.469996 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.470145 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.470319 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.470476 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.470617 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.470756 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.470896 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.471048 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.473309 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.473475 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.473633 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.473783 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.473933 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.474074 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.474226 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.474410 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.474557 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.474707 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.474854 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.475010 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.475167 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.475317 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.475510 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.475668 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.475849 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.476114 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.476270 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.476460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.476610 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.476765 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.476915 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.477055 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.477342 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.477495 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.477642 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.477792 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.477933 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.478080 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.485827 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.488578 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.488752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.488916 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.489074 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.489265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.489442 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.489603 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.489753 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.489963 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.490108 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.490285 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.490434 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.490591 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.490734 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.490882 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.491024 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.491024 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.491340 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.491512 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.491655 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.491803 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.491944 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.492095 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.492434 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.492588 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.492738 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.492886 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.493059 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.493612 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.493764 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.493915 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.494076 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.494234 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.494403 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.494639 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.494788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.494929 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.495103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.495302 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.495451 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.495593 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.496468 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.496468 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.496659 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.496762 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.496848 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.496939 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.497022 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.497105 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.497194 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.497287 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.497372 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.497459 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.497532 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.497601 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.497684 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.497756 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.497833 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.497910 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.497910 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.498044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.498123 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.498201 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.498273 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.498349 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.498428 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.498505 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.498589 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.498668 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.498745 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.498822 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.498893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.498962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.499043 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.499124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.499201 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.499416 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.499506 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:34:07.499592 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.499673 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.499744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.499822 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.499893 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.499962 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.500044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.500127 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.500203 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.500274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.500371 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.500445 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.500540 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.500625 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.500703 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.500781 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.500854 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.500923 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.500999 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.501078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.501149 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.501218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.501300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.501379 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.501456 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.501534 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.501605 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.501674 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.501743 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.501811 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.501892 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.501963 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.502032 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.502100 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.502175 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.502251 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.502405 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.502479 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.502479 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.502479 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.502693 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.502763 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.502854 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.502933 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.503003 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.503080 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.503151 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.503226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.503304 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.503304 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.503445 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.503445 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.503578 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.503659 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.503735 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.503735 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.503875 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.503875 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.504000 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.504076 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.504147 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.504223 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.504307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.505452 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.505611 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.505611 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.505611 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.506533 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.506690 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.506842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.506992 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.507134 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.507280 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.507280 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.507280 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.507280 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.507280 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.507280 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.507280 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.507280 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.508371 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.508371 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.508371 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.508371 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.508371 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.508371 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.508371 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.508371 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.509454 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.509454 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.509454 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.509454 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.509454 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.509454 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.509454 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.509454 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.510600 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.510600 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.510600 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.510600 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.511136 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.511283 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.511283 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.511283 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.511283 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.511283 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.511283 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.512296 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.512500 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.512651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.512830 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.512973 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.513113 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.513113 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.513385 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.513531 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.513685 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.513836 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.513975 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.514124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.514263 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.514421 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.514421 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.514698 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.514857 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.515006 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.515155 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.515310 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.515449 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.515594 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.515744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.515890 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.516029 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.516183 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.516361 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.516361 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.516361 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.522876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.523042 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.523200 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.523366 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.523366 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.523907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.524082 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.524082 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.524082 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.524543 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.524722 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.524722 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.524993 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.525148 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.525323 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.525477 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.525477 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.525801 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.525952 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.526117 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.526258 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.526430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.526584 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.526731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.526905 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.526905 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.528102 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.528247 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.528434 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.528579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.528719 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.528913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.529060 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.529200 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.529349 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.529489 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.529642 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.529783 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.529969 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.530121 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.530272 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.530412 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.530565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.530706 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.530855 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.531044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.531194 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.531334 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.531486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.531626 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.531765 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.531912 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.532085 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.532241 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.532414 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.532582 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.532582 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.532866 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.533040 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.533194 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.533341 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.533487 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.533626 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.533789 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.534027 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.534215 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.534360 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.534360 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.534360 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.534757 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.534915 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.534915 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.535415 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.535561 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.535701 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.535840 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.535979 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.536129 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.536129 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.536446 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.536446 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.536712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.536712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.537093 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.537275 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.537275 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.537539 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.537677 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.537824 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.537965 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.538103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.538304 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.538304 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.538580 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.538733 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.538891 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.539031 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.539210 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.539365 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.539513 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.539665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.539812 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.539951 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.540091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.540241 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.540418 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.540566 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.540706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.540854 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.540993 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.541139 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.541327 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.541475 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.541614 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.541760 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.541906 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.542051 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.542051 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.542371 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.542518 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.543274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.543274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.543577 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.543577 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.543577 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.544072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.544315 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.544494 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.544652 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.544652 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.544925 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.545064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.545203 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.545384 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.545556 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.545703 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.545851 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.545999 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.547060 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.547266 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.547425 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.547545 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.547655 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.547773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.547884 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.548000 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.548000 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.548210 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.558931 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.559238 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.559451 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.559712 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.560013 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.560499 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.560686 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.560851 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.561011 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.561160 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.561320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.561954 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.562124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.562292 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.562442 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.562596 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.562744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.562899 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.563061 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.563209 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.563365 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.563365 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.563806 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.564022 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.564826 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.564826 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.564993 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.564993 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.565155 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.565245 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.565245 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.565413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.565511 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.565511 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.565662 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.565752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.565843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.565926 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.566058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.566166 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.566257 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.566342 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.566431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.566514 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.566595 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.566686 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.566686 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.566843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.567145 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.567145 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.567305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.567398 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.567490 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.567581 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.567663 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.567796 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.567900 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.567985 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.568073 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.568155 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.568250 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.568362 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.568461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.568591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.568690 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.568774 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.568856 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.568945 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.569036 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.569120 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.569209 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.569292 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.569374 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.569462 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.569558 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.569648 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.569738 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.569821 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.569902 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.570076 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.570216 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.570303 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.570385 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.570475 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.570566 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.570656 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.570740 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.570822 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.570904 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.570992 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.571075 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.571169 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.571260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.571349 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.571349 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.571508 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.571600 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.571684 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.571773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.571856 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.571937 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.572025 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.572115 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.572205 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.572295 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.572399 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.572483 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.572483 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.572688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.572786 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.572871 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.572960 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.573050 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.573141 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.573141 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.573312 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.573532 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.573628 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.573720 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.573846 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.574683 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.574814 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.574909 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.575113 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.575207 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.575375 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.575468 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.575553 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.575643 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.575733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.575864 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.575971 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.576066 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.576151 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.576241 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.576339 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.576437 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.576437 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.576609 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.576730 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.576820 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.576902 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.576983 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.577093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.577343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.577435 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.577518 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.577601 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.577702 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.577793 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.577886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.577977 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.577977 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.578125 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.578219 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.578310 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.578399 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.578488 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.578576 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.578659 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.578755 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.578840 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.578921 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.579009 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.579092 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.579179 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.579179 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.579343 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.579431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.579514 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.579595 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.579875 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.579875 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.580179 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.580266 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.580385 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.580469 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.580469 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.580619 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.580689 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.580765 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.580844 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.580916 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.580994 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.581078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.581161 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.581242 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.581324 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.581414 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.581505 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.581597 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.581687 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.581777 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.581860 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.581941 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.582029 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.582111 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.582199 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.582295 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.582386 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.582469 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.582557 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.582647 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.582729 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.582824 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.582908 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.582995 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.583121 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.583219 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.583316 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.583407 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.583495 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.583578 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.583666 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.583757 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.583852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.584006 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.584101 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.584192 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.584282 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.584382 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.584479 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.584564 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.584819 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.584919 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.585003 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.585093 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.585338 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.585474 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.585584 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.585692 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.585802 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.585927 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.586038 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.586153 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.586268 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.586910 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.587034 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.587154 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.587291 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.587564 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.587691 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.587813 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.587922 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.588045 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.588163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.588163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.588353 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.588441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.588538 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.588631 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.588716 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.588806 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.588890 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.588978 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.589075 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.589165 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.589255 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.589338 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.589441 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.589532 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.589629 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.589714 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.589796 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.589884 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.589975 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.589975 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.590144 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.590235 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.590330 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.590458 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.590590 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.590690 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.590789 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.590873 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.590989 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.591123 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.591240 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.591359 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.591476 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.591476 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.591691 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.591799 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.591799 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.592016 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.592126 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.592234 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.592388 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.598215 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.598399 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.598557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.598709 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.598860 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.598979 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.599076 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.599324 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.599426 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.599500 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.599583 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.599665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.599755 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.599883 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.599883 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.600024 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.600024 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.600166 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.600251 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.600504 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.600595 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.600679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.600761 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.600851 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.600936 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.601032 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.601123 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.601214 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.601298 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.601519 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.601672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.601779 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.601874 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.601965 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.602049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.602138 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.602230 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.602320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.602404 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.602524 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.602602 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.602672 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.602751 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.602829 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.602913 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.602994 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.603075 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.603163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.603259 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.603459 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.603609 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.603756 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.603857 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.603943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.604067 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.604247 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.604461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.604562 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.604654 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.604872 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.604997 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.605131 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.605205 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.605282 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.605374 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.605455 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.605534 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.605605 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.605675 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.605744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.605820 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.605913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.605997 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.606095 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.606167 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.606237 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.606319 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.606416 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.606500 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.606589 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.606674 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.606756 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.606847 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.606919 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.607008 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.607099 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.607189 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.607272 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.607363 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.607453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.607537 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.607640 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.607901 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.608045 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.608152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.608245 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.608346 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.608346 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.608514 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.608514 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.608663 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.608747 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.608830 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.608919 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.609003 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.609097 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.609182 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.609182 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.609338 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.609338 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.609493 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.609590 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.609680 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.609763 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.609845 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.609926 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.610015 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.610106 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.610196 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.610285 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.610369 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.610369 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.610535 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.610626 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.610716 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.610804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.610894 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.610978 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.611058 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.611142 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.611231 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.611320 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.611403 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.611485 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.611579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.611671 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.611760 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.611843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.611924 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.612007 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.612097 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.612189 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.612290 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.612402 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.612501 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.612592 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.612683 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.612773 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.612858 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.612939 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.613033 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.613118 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.613207 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.613296 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.613379 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.613467 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.613558 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.613642 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.613731 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.613824 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.613908 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.614003 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.614087 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.614168 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.614250 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.614332 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.614414 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.614504 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.614589 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.614671 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.614759 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.614894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.614988 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.615087 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.615172 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.615429 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.615550 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.615669 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.615780 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.615898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.616016 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.616124 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.616232 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.616232 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.621467 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.621585 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.621681 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.621766 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.621857 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.621941 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.622033 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.622118 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.622208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.622300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.622384 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.622467 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.622671 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.622773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.622858 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.622941 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.623019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.623102 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.623194 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.623285 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.623369 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.623457 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.623547 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.623631 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.623773 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.623866 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.623950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.624032 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.624032 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.624189 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.624280 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.624381 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.624465 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.624559 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.624642 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.624763 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.624862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.624997 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.625089 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.625180 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.625305 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.625424 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.625523 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.625685 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.625778 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.625868 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.625959 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.626051 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.626051 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.626317 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.626580 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.626707 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.626865 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.626983 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.627100 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.627217 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.627334 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.627442 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.627442 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.627654 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.627770 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.627880 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.628196 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.628421 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.628555 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.628555 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.628761 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.628911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.628911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.629144 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.629288 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.629288 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.629509 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.629618 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.629618 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.629843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.629953 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.629953 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.630153 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.630261 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.630498 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.630823 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.631138 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.631459 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.631601 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.631783 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.631884 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.632102 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.632195 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.633336 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.633627 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.633742 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.633950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.634110 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.634241 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.634377 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.634548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.634732 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.634876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.635058 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.635190 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.635325 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.635451 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.635576 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.635718 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.635848 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.635984 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.636119 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.636249 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.637121 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.637263 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.637451 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.637595 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.637724 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.637871 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.637871 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.638137 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.638465 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.638596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.638724 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.638854 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.638999 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.639136 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.639264 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.639400 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.639536 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.639678 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.639807 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.639936 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.640064 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.640064 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.640305 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.640469 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.640596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.640713 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.640841 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.640841 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.641117 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.641264 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.641393 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.641522 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.641656 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.641791 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.641928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.642058 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.642194 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.642313 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.642439 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.642593 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.642735 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.642917 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.643051 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.643230 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.643362 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.643595 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.643856 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.643990 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.644308 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.644476 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.644589 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.649785 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.649906 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.649997 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.650212 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.650306 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.650379 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.650472 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.650558 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.650687 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.650808 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.650908 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.650993 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.651090 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.651184 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.651268 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.651350 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.651440 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.651532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.651628 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.651720 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.651808 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.651891 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.652001 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.652095 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.652198 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.652556 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.652648 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.652733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.652831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.652930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.653016 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.653109 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.653199 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.653283 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.653354 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.653504 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.653597 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.653597 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.653794 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.653892 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.653978 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.654071 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.654156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.654239 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.654322 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.654412 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.654496 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.654591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.654675 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.654675 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.654811 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.654890 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.655122 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.655287 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.655376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.655460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.655552 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.655694 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.655797 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.655892 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.655983 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.656077 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.656163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.656163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.656336 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.656462 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.656565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.656652 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.656736 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.656827 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.656924 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.657009 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.657101 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.657186 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.657276 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.657408 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.657509 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.657605 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.657698 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.657825 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.657959 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.658044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.658116 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.658200 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.658283 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.658366 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.658537 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.658765 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.658882 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.659095 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.659228 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.659448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.659578 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.659772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.659947 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.660107 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.660234 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.660473 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.660613 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.660841 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.660960 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.661152 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.661268 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.661482 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.661611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.661799 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.661957 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.662113 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.662243 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.662425 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.662556 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.662739 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.662864 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.663052 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.663170 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.663363 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.663481 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.663675 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.663792 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.663989 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.664113 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.664302 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.664451 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.664639 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.664757 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.664953 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.665085 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.665265 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.665391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.665579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.665735 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.665903 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.666069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.666202 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.666330 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.666538 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.666694 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.666901 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.667059 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.667215 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.667426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.667608 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.667764 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.667922 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.668071 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.668220 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.668423 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.668579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.668756 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.669010 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.669173 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.669323 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.669484 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.669632 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.669779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.669934 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.670092 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.670303 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.670454 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.670655 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.670959 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.671123 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.671273 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.671422 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.671622 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.671786 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.671986 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.672253 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.678625 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.678881 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.679044 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.679187 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.679454 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.679600 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.679729 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.679862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.679991 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.680133 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.680133 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.680504 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.680637 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.680768 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.680907 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.681046 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.681183 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.681455 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.681602 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.681778 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.681970 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.682192 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.682380 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.682553 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.682756 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.682958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.683134 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.683912 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.684092 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.684293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.684504 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.684648 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.684806 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.684996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.685127 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.685270 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.685415 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.685891 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.686149 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.686588 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.686789 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.686986 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.687129 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.687269 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.687417 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.687556 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.687685 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.687825 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.687961 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.688105 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.688338 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.688482 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.688612 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.688741 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.688889 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.689088 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.689238 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.689368 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.689517 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.689647 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.689802 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.689948 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.690078 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.690332 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.690477 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.690607 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.690751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.690898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.691028 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.691157 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.691287 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.691425 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.691555 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.691701 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.691839 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.691976 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.692118 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.692259 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.692405 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.692553 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.692684 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.692813 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.692943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.692943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.693205 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.693335 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.693471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.693471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.693732 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.693859 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.693999 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.694128 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.694267 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.694407 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.694551 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.694687 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.694842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.694972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.695112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.695112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.695543 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.695726 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.696059 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.696240 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.696474 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.696682 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.696871 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.697069 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.697270 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.697477 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.697676 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.697845 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.698027 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.698172 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.698314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.698453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.698594 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.698736 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.698999 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.699146 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.699282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.699585 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.699720 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.699868 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.700016 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.700154 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.700283 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.700520 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.700672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.700812 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.700992 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.701120 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.701253 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.701383 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.701512 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.701652 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.701799 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.701928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.702113 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.702251 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.702415 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.702564 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.702748 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.702916 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.703059 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.703189 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.703353 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.703502 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.703641 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.703771 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.703910 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.704048 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.704176 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.704361 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.704504 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.704504 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.704772 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.704910 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.705056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.705195 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.705334 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.705466 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.705596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.705723 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.706055 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.706198 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.706372 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.706522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.706650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.706650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:34:07.706973 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.706973 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.706973 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.706973 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.706973 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.706973 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.706973 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.706973 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.708085 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.708085 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.708085 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.708085 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.708085 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.708085 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.708085 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.708085 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.709325 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.709325 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.709325 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.709325 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.709325 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.709325 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.709325 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.709325 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.710441 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.710441 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.710441 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.710441 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.710441 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.710441 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.710441 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.710441 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.711390 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.711390 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.711390 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.711390 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.711390 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.711390 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.711390 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.711390 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.712252 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.712252 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.712252 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.712252 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.712689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.712878 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.713196 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.713517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.715263 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.715984 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.716303 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.716673 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.717025 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.717360 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.717686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.718032 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.718358 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.718682 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.719000 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.719320 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.719639 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.719956 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.721024 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.721024 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.721024 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.721664 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.721664 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.722013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.722203 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.722480 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.722843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.723143 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.723457 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.723775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.724168 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.724514 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.724836 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.725153 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.725465 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.725784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.726103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.726432 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.726843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.727165 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.727496 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.727824 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.728174 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.728523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.728872 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.729282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.729715 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.730055 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.730949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:34:07.731195 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:34:07.763310 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO dbcounter [None req-621e3182-301d-43c1-834d-8e85d2efd8bd None None] Registered counter for database nova_api Aug 31 00:34:07.787181 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_db.sqlalchemy.engines [None req-621e3182-301d-43c1-834d-8e85d2efd8bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128048) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:34:07.795511 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writer thread running {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:34:07.795784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO dbcounter [None req-90edf811-6928-4ee2-ba48-ec45877b4589 None None] Registered counter for database nova_api Aug 31 00:34:07.816543 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_db.sqlalchemy.engines [None req-90edf811-6928-4ee2-ba48-ec45877b4589 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:34:07.823345 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writer thread running {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:34:07.854121 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.context [None req-621e3182-301d-43c1-834d-8e85d2efd8bd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cc00dc75-3ec6-4d28-be0f-5f2a558d3e31(cell1) {{(pid=128048) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 00:34:07.858260 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-621e3182-301d-43c1-834d-8e85d2efd8bd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:34:07.858745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-621e3182-301d-43c1-834d-8e85d2efd8bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:34:07.860348 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-621e3182-301d-43c1-834d-8e85d2efd8bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:34:07.861099 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-621e3182-301d-43c1-834d-8e85d2efd8bd None None] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:34:07.861550 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-621e3182-301d-43c1-834d-8e85d2efd8bd None None] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:34:07.863596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-621e3182-301d-43c1-834d-8e85d2efd8bd None None] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:34:07.865748 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO dbcounter [None req-621e3182-301d-43c1-834d-8e85d2efd8bd None None] Registered counter for database nova_cell0 Aug 31 00:34:07.870424 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO dbcounter [None req-621e3182-301d-43c1-834d-8e85d2efd8bd None None] Registered counter for database nova_cell1 Aug 31 00:34:07.878140 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_db.sqlalchemy.engines [None req-621e3182-301d-43c1-834d-8e85d2efd8bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128048) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:34:07.880779 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_db.sqlalchemy.engines [None req-621e3182-301d-43c1-834d-8e85d2efd8bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128048) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:34:07.884481 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.context [None req-90edf811-6928-4ee2-ba48-ec45877b4589 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cc00dc75-3ec6-4d28-be0f-5f2a558d3e31(cell1) {{(pid=128049) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 00:34:07.889009 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writer thread running {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:34:07.889339 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-90edf811-6928-4ee2-ba48-ec45877b4589 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:34:07.890080 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-90edf811-6928-4ee2-ba48-ec45877b4589 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:34:07.890463 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writer thread running {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:34:07.892041 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-90edf811-6928-4ee2-ba48-ec45877b4589 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:34:07.892819 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-90edf811-6928-4ee2-ba48-ec45877b4589 None None] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:34:07.893267 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-90edf811-6928-4ee2-ba48-ec45877b4589 None None] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:34:07.895279 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-90edf811-6928-4ee2-ba48-ec45877b4589 None None] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:34:07.897344 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO dbcounter [None req-90edf811-6928-4ee2-ba48-ec45877b4589 None None] Registered counter for database nova_cell0 Aug 31 00:34:07.901558 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO dbcounter [None req-90edf811-6928-4ee2-ba48-ec45877b4589 None None] Registered counter for database nova_cell1 Aug 31 00:34:07.909563 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_db.sqlalchemy.engines [None req-90edf811-6928-4ee2-ba48-ec45877b4589 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:34:07.911881 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_db.sqlalchemy.engines [None req-90edf811-6928-4ee2-ba48-ec45877b4589 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:34:07.919991 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writer thread running {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:34:07.921831 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writer thread running {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:34:08.044939 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO dbcounter [None req-621e3182-301d-43c1-834d-8e85d2efd8bd None None] Registered counter for database nova_cell0 Aug 31 00:34:08.051669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_db.sqlalchemy.engines [None req-621e3182-301d-43c1-834d-8e85d2efd8bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128048) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:34:08.056277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writer thread running {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:34:08.074514 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO dbcounter [None req-90edf811-6928-4ee2-ba48-ec45877b4589 None None] Registered counter for database nova_cell0 Aug 31 00:34:08.081413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_db.sqlalchemy.engines [None req-90edf811-6928-4ee2-ba48-ec45877b4589 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:34:08.085854 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writer thread running {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:34:08.381041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: WARNING keystonemiddleware.auth_token [None req-621e3182-301d-43c1-834d-8e85d2efd8bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:34:08.389337 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: WARNING keystonemiddleware.auth_token [None req-621e3182-301d-43c1-834d-8e85d2efd8bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:34:08.409881 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: WARNING keystonemiddleware.auth_token [None req-90edf811-6928-4ee2-ba48-ec45877b4589 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:34:08.417291 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: WARNING keystonemiddleware.auth_token [None req-90edf811-6928-4ee2-ba48-ec45877b4589 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:34:08.743972 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: WARNING keystonemiddleware.auth_token [None req-621e3182-301d-43c1-834d-8e85d2efd8bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:34:08.750864 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: WARNING keystonemiddleware.auth_token [None req-621e3182-301d-43c1-834d-8e85d2efd8bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:34:08.756473 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5594a435b9c0 pid: 128048 (default app) Aug 31 00:34:08.765755 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: WARNING keystonemiddleware.auth_token [None req-90edf811-6928-4ee2-ba48-ec45877b4589 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 00:34:08.771755 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: WARNING keystonemiddleware.auth_token [None req-90edf811-6928-4ee2-ba48-ec45877b4589 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 00:34:08.777617 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5594a435b9c0 pid: 128049 (default app) Aug 31 00:34:45.755381 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=3 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:34:45.756195 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=3 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:34:45.756999 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=3 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:34:45.757763 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=3 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:34:46.634873 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=3 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:34:46.635728 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=3 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:34:46.637118 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=3 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:34:46.638786 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=3 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:34:47.423688 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-6d544518-0ee2-4e25-8a86-61f176f6df27 tempest-VolumesGetTestJSON-1904409810 tempest-VolumesGetTestJSON-1904409810-project] Action: 'create', calling method: .version_select at 0x7f551fac2e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-252535870", "metadata": {"Type": "work"}}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6d442229-6580-4035-8e4f-c4b1b917ea4c tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] Action: 'create', calling method: .version_select at 0x7f551fac2e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-803438250", "metadata": {"Type": "work"}}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6d442229-6580-4035-8e4f-c4b1b917ea4c tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] Request method failure captured: Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 121 Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqymclt5RzRsMVNMrXGkMHs3sfhYdQNMXDDyQOl7UD3YE-yTcn7EEBZ0bU0jr0N_BhzlrYeDoNWeX36BpbIm-4tDQ9jmV3fmSR7qCsJRlZ1u6EThykhsnzJLZoYIkVdskN0tU7q7uexZasjA_KvXSUZsmFsAeTTOFS25KXQjtUThw2E Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: b05557d292f240d690687db45cfcbffc Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-VolumesNegativeTest-678910102 Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:34:48.631893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:34:48.640933 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b05557d292f240d690687db45cfcbffc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b05557d292f240d690687db45cfcbffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b05557d292f240d690687db45cfcbffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b05557d292f240d690687db45cfcbffc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:34:48.640933 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-VolumesNegativeTest-678910102 Aug 31 00:34:48.640933 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: b05557d292f240d690687db45cfcbffc Aug 31 00:34:48.640933 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-VolumesNegativeTest-678910102 Aug 31 00:34:48.640933 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-VolumesNegativeTest-678910102-project Aug 31 00:34:48.640933 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:34:48.640933 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:34:48.640933 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 7472ccd1202a4bf0b91e75fece3ca913 Aug 31 00:34:48.640933 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-VolumesNegativeTest-678910102-project Aug 31 00:34:48.640933 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Aug 31 00:34:48.640933 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-803438250", "metadata": {"Type": "work"}}} Aug 31 00:34:48.640933 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: Aug 31 00:34:48.640933 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-803438250', 'metadata': {'Type': 'work'}}}} Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise error Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:34:48.655274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:34:48.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:34:48.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:34:48.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:34:48.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:34:48.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 00:34:48.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 00:34:48.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 00:34:48.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 00:34:48.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 00:34:48.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 00:34:48.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 00:34:48.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:34:48.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:48.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:34:48.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:34:48.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 00:34:48.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 00:34:48.676658 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 00:34:48.676658 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.676658 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6d442229-6580-4035-8e4f-c4b1b917ea4c tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:34:48.676658 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6d442229-6580-4035-8e4f-c4b1b917ea4c tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.755633 Aug 31 00:34:48.676658 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 1/1] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 31 00:34:46 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1769 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:34:48.676658 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-28f8ecf3-f2b4-4255-951b-c6d28161a01a tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] Action: 'create', calling method: .version_select at 0x7f551fa8e940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1464711553", "metadata": {"Type": "work"}}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:34:48.676658 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-28f8ecf3-f2b4-4255-951b-c6d28161a01a tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] Request method failure captured: Aug 31 00:34:48.676658 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 00:34:48.676658 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:34:48.684930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:34:48.684930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:34:48.684930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 120 Aug 31 00:34:48.684930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:34:48.684930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:34:48.684930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:34:48.684930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:34:48.684930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqymclt5RzRsMVNMrXGkMHs3sfhYdQNMXDDyQOl7UD3YE-yTcn7EEBZ0bU0jr0N_BhzlrYeDoNWeX36BpbIm-4tDQ9jmV3fmSR7qCsJRlZ1u6EThykhsnzJLZoYIkVdskN0tU7q7uexZasjA_KvXSUZsmFsAeTTOFS25KXQjtUThw2E Aug 31 00:34:48.684930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:34:48.684930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:34:48.684930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:34:48.684930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:34:48.684930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:34:48.684930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:34:48.684930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: b05557d292f240d690687db45cfcbffc Aug 31 00:34:48.684930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-VolumesNegativeTest-678910102 Aug 31 00:34:48.684930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:34:48.684930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:34:48.684930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b05557d292f240d690687db45cfcbffc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b05557d292f240d690687db45cfcbffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b05557d292f240d690687db45cfcbffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b05557d292f240d690687db45cfcbffc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-VolumesNegativeTest-678910102 Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: b05557d292f240d690687db45cfcbffc Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-VolumesNegativeTest-678910102 Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-VolumesNegativeTest-678910102-project Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 7472ccd1202a4bf0b91e75fece3ca913 Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-VolumesNegativeTest-678910102-project Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1464711553", "metadata": {"Type": "work"}}} Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1464711553', 'metadata': {'Type': 'work'}}}} Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise error Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi '0' Aug 31 00:34:48.691565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.694063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:34:48.696225 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.696225 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:48.696225 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:34:48.696225 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:34:48.696225 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 00:34:48.696225 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 00:34:48.696225 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 00:34:48.696225 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.696225 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-28f8ecf3-f2b4-4255-951b-c6d28161a01a tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:34:48.696225 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-28f8ecf3-f2b4-4255-951b-c6d28161a01a tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009879 Aug 31 00:34:48.696225 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 2/2] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 31 00:34:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-66369bee-5ca4-4fd9-b44b-9a08973a9b80 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] Action: 'create', calling method: .version_select at 0x7f551f98e9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1094256255", "metadata": {"Type": "work"}}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-66369bee-5ca4-4fd9-b44b-9a08973a9b80 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] Request method failure captured: Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 119 Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqymclt5RzRsMVNMrXGkMHs3sfhYdQNMXDDyQOl7UD3YE-yTcn7EEBZ0bU0jr0N_BhzlrYeDoNWeX36BpbIm-4tDQ9jmV3fmSR7qCsJRlZ1u6EThykhsnzJLZoYIkVdskN0tU7q7uexZasjA_KvXSUZsmFsAeTTOFS25KXQjtUThw2E Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: b05557d292f240d690687db45cfcbffc Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-VolumesNegativeTest-678910102 Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:34:48.697532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:34:48.699438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b05557d292f240d690687db45cfcbffc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b05557d292f240d690687db45cfcbffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b05557d292f240d690687db45cfcbffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b05557d292f240d690687db45cfcbffc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:34:48.699438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-VolumesNegativeTest-678910102 Aug 31 00:34:48.699438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: b05557d292f240d690687db45cfcbffc Aug 31 00:34:48.699438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-VolumesNegativeTest-678910102 Aug 31 00:34:48.699438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-VolumesNegativeTest-678910102-project Aug 31 00:34:48.699438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:34:48.699438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:34:48.699438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 7472ccd1202a4bf0b91e75fece3ca913 Aug 31 00:34:48.699438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-VolumesNegativeTest-678910102-project Aug 31 00:34:48.699438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Aug 31 00:34:48.699438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1094256255", "metadata": {"Type": "work"}}} Aug 31 00:34:48.699438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: Aug 31 00:34:48.699438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1094256255', 'metadata': {'Type': 'work'}}}} Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise error Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi '' Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:34:48.701886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:34:48.706221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:34:48.706221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:34:48.706221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:34:48.706221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:34:48.706221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 00:34:48.706221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 00:34:48.706221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 00:34:48.706221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 00:34:48.706221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 00:34:48.706221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 00:34:48.706221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 00:34:48.706221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.706221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:34:48.706221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.706221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:48.706221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:34:48.706221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:34:48.706221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 00:34:48.706221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 00:34:48.708843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 00:34:48.708843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:48.708843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-66369bee-5ca4-4fd9-b44b-9a08973a9b80 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:34:48.708843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-66369bee-5ca4-4fd9-b44b-9a08973a9b80 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013767 Aug 31 00:34:48.708843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 3/3] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 31 00:34:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:34:48.708843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-544b8d02-4735-4bdd-b996-c75d938b9149 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] Calling method '.version_select at 0x7f551f98e700>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:34:49.308990 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-544b8d02-4735-4bdd-b996-c75d938b9149 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] HTTP exception thrown: Volume tempest-invalid-1685583384 could not be found. Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-544b8d02-4735-4bdd-b996-c75d938b9149 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] Request method failure captured: Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1685583384 HTTP/1.1 Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqymclt5RzRsMVNMrXGkMHs3sfhYdQNMXDDyQOl7UD3YE-yTcn7EEBZ0bU0jr0N_BhzlrYeDoNWeX36BpbIm-4tDQ9jmV3fmSR7qCsJRlZ1u6EThykhsnzJLZoYIkVdskN0tU7q7uexZasjA_KvXSUZsmFsAeTTOFS25KXQjtUThw2E Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: b05557d292f240d690687db45cfcbffc Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-VolumesNegativeTest-678910102 Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:34:49.317932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:34:49.318898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b05557d292f240d690687db45cfcbffc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b05557d292f240d690687db45cfcbffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b05557d292f240d690687db45cfcbffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b05557d292f240d690687db45cfcbffc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:34:49.318898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-VolumesNegativeTest-678910102 Aug 31 00:34:49.318898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: b05557d292f240d690687db45cfcbffc Aug 31 00:34:49.318898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-VolumesNegativeTest-678910102 Aug 31 00:34:49.318898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-VolumesNegativeTest-678910102-project Aug 31 00:34:49.318898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:34:49.318898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:34:49.318898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 7472ccd1202a4bf0b91e75fece3ca913 Aug 31 00:34:49.318898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-VolumesNegativeTest-678910102-project Aug 31 00:34:49.318898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: Aug 31 00:34:49.318898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Volume tempest-invalid-1685583384 could not be found. Aug 31 00:34:49.318898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': 'tempest-invalid-1685583384'} Aug 31 00:34:49.318898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:34:49.321972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:49.321972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:34:49.321972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:34:49.321972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:34:49.321972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:34:49.321972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:34:49.321972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:34:49.321972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:34:49.321972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:34:49.321972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:34:49.321972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:34:49.321972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:34:49.321972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:34:49.321972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:34:49.321972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:34:49.321972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1685583384 could not be found. (HTTP 404) (Request-ID: req-358e4455-349e-49c5-868f-86dd07a4ad6d) Aug 31 00:34:49.321972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.321972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:34:49.321972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.323054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:49.323054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 00:34:49.323054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 00:34:49.323054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:34:49.323054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:34:49.323054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:34:49.323054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:34:49.323054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:34:49.323054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:34:49.323054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:34:49.323054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:34:49.323054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:34:49.323054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:34:49.323054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:34:49.323054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:34:49.323054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:34:49.323054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:34:49.323054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:34:49.323054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1685583384 could not be found. Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:34:49.323928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1685583384 could not be found. Aug 31 00:34:49.324849 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.324849 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:34:49.324849 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.324849 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:49.324849 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:34:49.324849 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:34:49.324849 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:34:49.324849 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:34:49.324849 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1685583384 could not be found. Aug 31 00:34:49.324849 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.324849 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-544b8d02-4735-4bdd-b996-c75d938b9149 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] Returning 404 to user: Volume tempest-invalid-1685583384 could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:34:49.324849 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-544b8d02-4735-4bdd-b996-c75d938b9149 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1685583384" status: 404 len: 99 microversion: 2.1 time: 0.885680 Aug 31 00:34:49.324849 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 4/4] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Aug 31 00:34:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1685583384 => generated 99 bytes in 893 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 00:34:49.330200 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-fd97c96b-f747-446b-84e4-4ab07a602b48 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006664 Aug 31 00:34:49.335366 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 5/5] 10.222.0.65 () {58 vars in 1140 bytes} [Wed Aug 31 00:34:49 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 00:34:49.341892 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c56216f6-f0d1-4a68-ab78-238a1cbfc54e tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005047 Aug 31 00:34:49.342485 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 6/6] 10.222.0.65 () {58 vars in 1137 bytes} [Wed Aug 31 00:34:49 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 00:34:49.352564 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-635af8c3-b904-44a6-88d8-5e1efffffc36 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] Calling method '.version_select at 0x7f551f8d2ca0>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:34:49.543064 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-635af8c3-b904-44a6-88d8-5e1efffffc36 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] HTTP exception thrown: Volume b4e34144-08e9-4f3e-a6ad-2d0c86a66d65 could not be found. Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-635af8c3-b904-44a6-88d8-5e1efffffc36 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] Request method failure captured: Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: DELETE /compute/v2.1/os-volumes/b4e34144-08e9-4f3e-a6ad-2d0c86a66d65 HTTP/1.1 Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqymclt5RzRsMVNMrXGkMHs3sfhYdQNMXDDyQOl7UD3YE-yTcn7EEBZ0bU0jr0N_BhzlrYeDoNWeX36BpbIm-4tDQ9jmV3fmSR7qCsJRlZ1u6EThykhsnzJLZoYIkVdskN0tU7q7uexZasjA_KvXSUZsmFsAeTTOFS25KXQjtUThw2E Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: b05557d292f240d690687db45cfcbffc Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-VolumesNegativeTest-678910102 Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:34:49.548461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:34:49.549523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b05557d292f240d690687db45cfcbffc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b05557d292f240d690687db45cfcbffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b05557d292f240d690687db45cfcbffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b05557d292f240d690687db45cfcbffc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:34:49.549523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-VolumesNegativeTest-678910102 Aug 31 00:34:49.549523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: b05557d292f240d690687db45cfcbffc Aug 31 00:34:49.549523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-VolumesNegativeTest-678910102 Aug 31 00:34:49.549523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-VolumesNegativeTest-678910102-project Aug 31 00:34:49.549523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:34:49.549523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:34:49.549523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 7472ccd1202a4bf0b91e75fece3ca913 Aug 31 00:34:49.549523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-VolumesNegativeTest-678910102-project Aug 31 00:34:49.549523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: Aug 31 00:34:49.549523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Volume b4e34144-08e9-4f3e-a6ad-2d0c86a66d65 could not be found. Aug 31 00:34:49.549523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': 'b4e34144-08e9-4f3e-a6ad-2d0c86a66d65'} Aug 31 00:34:49.549523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:34:49.550147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:49.550147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:34:49.550147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:34:49.550147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:34:49.550147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:34:49.550147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:34:49.550147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:34:49.550147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:34:49.550147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:34:49.550147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:34:49.550147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:34:49.550147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:34:49.550147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:34:49.550147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:34:49.550147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:34:49.550147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4e34144-08e9-4f3e-a6ad-2d0c86a66d65 could not be found. (HTTP 404) (Request-ID: req-cc20fa5c-c4f9-433c-a6e7-585cce4b3ec5) Aug 31 00:34:49.550147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.550147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:34:49.550147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.550988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:49.550988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 00:34:49.550988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 00:34:49.550988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:34:49.550988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:34:49.550988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:34:49.550988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:34:49.550988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:34:49.550988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:34:49.550988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:34:49.550988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:34:49.550988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:34:49.550988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:34:49.550988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:34:49.550988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:34:49.550988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:34:49.550988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:34:49.550988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:34:49.550988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:34:49.553709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:34:49.553709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:34:49.553709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:34:49.553709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:34:49.553709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4e34144-08e9-4f3e-a6ad-2d0c86a66d65 could not be found. Aug 31 00:34:49.553709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.553709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:34:49.553709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.553709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:49.553709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:34:49.553709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:34:49.553709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:34:49.553709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:34:49.553709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:34:49.553709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:34:49.553709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:34:49.553709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:34:49.553709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 00:34:49.553709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:34:49.554706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4e34144-08e9-4f3e-a6ad-2d0c86a66d65 could not be found. Aug 31 00:34:49.554706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.554706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:34:49.554706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.554706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:49.554706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:34:49.554706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:34:49.554706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:34:49.554706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:34:49.554706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4e34144-08e9-4f3e-a6ad-2d0c86a66d65 could not be found. Aug 31 00:34:49.554706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.554706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-635af8c3-b904-44a6-88d8-5e1efffffc36 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] Returning 404 to user: Volume b4e34144-08e9-4f3e-a6ad-2d0c86a66d65 could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:34:49.554706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-635af8c3-b904-44a6-88d8-5e1efffffc36 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/b4e34144-08e9-4f3e-a6ad-2d0c86a66d65" status: 404 len: 109 microversion: 2.1 time: 0.201811 Aug 31 00:34:49.558665 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 7/7] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 00:34:49 2022] DELETE /compute/v2.1/os-volumes/b4e34144-08e9-4f3e-a6ad-2d0c86a66d65 => generated 109 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:34:49.570029 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4757711c-3b4d-49a4-8fa8-5e66e84ff4b1 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] Calling method '.version_select at 0x7f551f8d2550>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:34:49.941540 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-4757711c-3b4d-49a4-8fa8-5e66e84ff4b1 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] HTTP exception thrown: Volume 6c2b04bc-ce47-4586-9bb8-3726f97d6d68 could not be found. Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4757711c-3b4d-49a4-8fa8-5e66e84ff4b1 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] Request method failure captured: Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/os-volumes/6c2b04bc-ce47-4586-9bb8-3726f97d6d68 HTTP/1.1 Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqymclt5RzRsMVNMrXGkMHs3sfhYdQNMXDDyQOl7UD3YE-yTcn7EEBZ0bU0jr0N_BhzlrYeDoNWeX36BpbIm-4tDQ9jmV3fmSR7qCsJRlZ1u6EThykhsnzJLZoYIkVdskN0tU7q7uexZasjA_KvXSUZsmFsAeTTOFS25KXQjtUThw2E Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: b05557d292f240d690687db45cfcbffc Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-VolumesNegativeTest-678910102 Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:34:49.945188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:34:49.946492 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b05557d292f240d690687db45cfcbffc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b05557d292f240d690687db45cfcbffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b05557d292f240d690687db45cfcbffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b05557d292f240d690687db45cfcbffc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:34:49.946492 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-VolumesNegativeTest-678910102 Aug 31 00:34:49.946492 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: b05557d292f240d690687db45cfcbffc Aug 31 00:34:49.946492 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-VolumesNegativeTest-678910102 Aug 31 00:34:49.946492 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-VolumesNegativeTest-678910102-project Aug 31 00:34:49.946492 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:34:49.946492 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:34:49.946492 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 7472ccd1202a4bf0b91e75fece3ca913 Aug 31 00:34:49.946492 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-VolumesNegativeTest-678910102-project Aug 31 00:34:49.946492 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: Aug 31 00:34:49.946492 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Volume 6c2b04bc-ce47-4586-9bb8-3726f97d6d68 could not be found. Aug 31 00:34:49.946492 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': '6c2b04bc-ce47-4586-9bb8-3726f97d6d68'} Aug 31 00:34:49.946492 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:34:49.947293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:49.947293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:34:49.947293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:34:49.947293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:34:49.947293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:34:49.947293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:34:49.947293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:34:49.947293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:34:49.947293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:34:49.947293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:34:49.947293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:34:49.947293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:34:49.947293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:34:49.947293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:34:49.947293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:34:49.947293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c2b04bc-ce47-4586-9bb8-3726f97d6d68 could not be found. (HTTP 404) (Request-ID: req-03bd5a00-a98c-4ee6-92f7-273d05d8c98a) Aug 31 00:34:49.947293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.947293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:34:49.947293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.948430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:49.948430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 00:34:49.948430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 00:34:49.948430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:34:49.948430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:34:49.948430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:34:49.948430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:34:49.948430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:34:49.948430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:34:49.948430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:34:49.948430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:34:49.948430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:34:49.948430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:34:49.948430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:34:49.948430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:34:49.948430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:34:49.948430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:34:49.948430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:34:49.948430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:34:49.949502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:34:49.949502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:34:49.949502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:34:49.949502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:34:49.949502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c2b04bc-ce47-4586-9bb8-3726f97d6d68 could not be found. Aug 31 00:34:49.949502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.949502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:34:49.949502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.949502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:49.949502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:34:49.949502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:34:49.949502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:34:49.949502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:34:49.949502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:34:49.949502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:34:49.949502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:34:49.949502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:34:49.949502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 00:34:49.949502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:34:49.951356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c2b04bc-ce47-4586-9bb8-3726f97d6d68 could not be found. Aug 31 00:34:49.951356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.951356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:34:49.951356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.951356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:49.951356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:34:49.951356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:34:49.951356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:34:49.951356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:34:49.951356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c2b04bc-ce47-4586-9bb8-3726f97d6d68 could not be found. Aug 31 00:34:49.951356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:34:49.955316 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4757711c-3b4d-49a4-8fa8-5e66e84ff4b1 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] Returning 404 to user: Volume 6c2b04bc-ce47-4586-9bb8-3726f97d6d68 could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:34:49.956539 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4757711c-3b4d-49a4-8fa8-5e66e84ff4b1 tempest-VolumesNegativeTest-678910102 tempest-VolumesNegativeTest-678910102-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/6c2b04bc-ce47-4586-9bb8-3726f97d6d68" status: 404 len: 109 microversion: 2.1 time: 0.395620 Aug 31 00:34:49.990155 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 8/8] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 00:34:49 2022] GET /compute/v2.1/os-volumes/6c2b04bc-ce47-4586-9bb8-3726f97d6d68 => generated 109 bytes in 423 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:34:50.059324 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-6d544518-0ee2-4e25-8a86-61f176f6df27 tempest-VolumesGetTestJSON-1904409810 tempest-VolumesGetTestJSON-1904409810-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.326127 Aug 31 00:34:50.060226 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 1/9] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 31 00:34:45 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4329 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 00:34:50.079512 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-05512b26-d9ae-44b7-9c2c-0165bcc66e1d tempest-VolumesGetTestJSON-1904409810 tempest-VolumesGetTestJSON-1904409810-project] Calling method '.version_select at 0x7f551f8d2a60>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:34:50.296713 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-05512b26-d9ae-44b7-9c2c-0165bcc66e1d tempest-VolumesGetTestJSON-1904409810 tempest-VolumesGetTestJSON-1904409810-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/cc871eb3-7fc3-4b84-b36f-633ee874f168" status: 200 len: 352 microversion: 2.1 time: 0.226277 Aug 31 00:34:50.302927 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 9/10] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 00:34:50 2022] GET /compute/v2.1/os-volumes/cc871eb3-7fc3-4b84-b36f-633ee874f168 => generated 352 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:34:51.311830 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f2b8a331-736d-43eb-a0da-b310e3402af7 tempest-VolumesGetTestJSON-1904409810 tempest-VolumesGetTestJSON-1904409810-project] Calling method '.version_select at 0x7f551f948ca0>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:34:51.405018 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f2b8a331-736d-43eb-a0da-b310e3402af7 tempest-VolumesGetTestJSON-1904409810 tempest-VolumesGetTestJSON-1904409810-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/cc871eb3-7fc3-4b84-b36f-633ee874f168" status: 200 len: 353 microversion: 2.1 time: 0.097974 Aug 31 00:34:51.406307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 2/11] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 00:34:51 2022] GET /compute/v2.1/os-volumes/cc871eb3-7fc3-4b84-b36f-633ee874f168 => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:34:51.424533 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-e65f1a06-9570-4f89-bdb9-292ae2c00aed tempest-VolumesGetTestJSON-1904409810 tempest-VolumesGetTestJSON-1904409810-project] Calling method '.version_select at 0x7f551f8d23a0>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:34:51.542697 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-e65f1a06-9570-4f89-bdb9-292ae2c00aed tempest-VolumesGetTestJSON-1904409810 tempest-VolumesGetTestJSON-1904409810-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/cc871eb3-7fc3-4b84-b36f-633ee874f168" status: 200 len: 353 microversion: 2.1 time: 0.128074 Aug 31 00:34:51.543795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 10/12] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 00:34:51 2022] GET /compute/v2.1/os-volumes/cc871eb3-7fc3-4b84-b36f-633ee874f168 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:34:51.562197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-fa00a128-2669-4df5-a9cf-70083a840256 tempest-VolumesGetTestJSON-1904409810 tempest-VolumesGetTestJSON-1904409810-project] Calling method '.version_select at 0x7f551f95e3a0>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:34:51.867710 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-fa00a128-2669-4df5-a9cf-70083a840256 tempest-VolumesGetTestJSON-1904409810 tempest-VolumesGetTestJSON-1904409810-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/cc871eb3-7fc3-4b84-b36f-633ee874f168" status: 202 len: 0 microversion: 2.1 time: 0.306503 Aug 31 00:34:51.867710 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 3/13] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 00:34:51 2022] DELETE /compute/v2.1/os-volumes/cc871eb3-7fc3-4b84-b36f-633ee874f168 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:34:51.872264 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a2fd7ab2-efe4-42e5-a8a7-30e36e8a7d63 tempest-VolumesGetTestJSON-1904409810 tempest-VolumesGetTestJSON-1904409810-project] Calling method '.version_select at 0x7f551f86a430>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:34:52.149393 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a2fd7ab2-efe4-42e5-a8a7-30e36e8a7d63 tempest-VolumesGetTestJSON-1904409810 tempest-VolumesGetTestJSON-1904409810-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/cc871eb3-7fc3-4b84-b36f-633ee874f168" status: 200 len: 352 microversion: 2.1 time: 0.280956 Aug 31 00:34:52.152372 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 11/14] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 00:34:51 2022] GET /compute/v2.1/os-volumes/cc871eb3-7fc3-4b84-b36f-633ee874f168 => generated 352 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:34:53.166397 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-33ac6960-50f0-4f46-ba5d-e4f654190400 tempest-VolumesGetTestJSON-1904409810 tempest-VolumesGetTestJSON-1904409810-project] Calling method '.version_select at 0x7f551f95eaf0>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:34:53.230838 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-33ac6960-50f0-4f46-ba5d-e4f654190400 tempest-VolumesGetTestJSON-1904409810 tempest-VolumesGetTestJSON-1904409810-project] HTTP exception thrown: Volume cc871eb3-7fc3-4b84-b36f-633ee874f168 could not be found. Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-33ac6960-50f0-4f46-ba5d-e4f654190400 tempest-VolumesGetTestJSON-1904409810 tempest-VolumesGetTestJSON-1904409810-project] Request method failure captured: Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: GET /compute/v2.1/os-volumes/cc871eb3-7fc3-4b84-b36f-633ee874f168 HTTP/1.1 Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDqyl_7AuPc3za0jTdqcNeEJG60I23H6xDQy68YeZX5lHtMR_bAIL_wcrMsKqnQfzDLnjJYHvEzRzjXMuQGxOYOrI9WIg7geYqhMtabjJSZ8DvbfdOGtvc1gm9zK15NROe6Z5m-s1oAABNzU-W01rYHH5EMawC8Zb22FGrrJQzwXcXPA Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: e931d084c75b4dd3871922e92e278f88 Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-VolumesGetTestJSON-1904409810 Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:34:53.236712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:34:53.238064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e931d084c75b4dd3871922e92e278f88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e931d084c75b4dd3871922e92e278f88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e931d084c75b4dd3871922e92e278f88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e931d084c75b4dd3871922e92e278f88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:34:53.238064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-VolumesGetTestJSON-1904409810 Aug 31 00:34:53.238064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: e931d084c75b4dd3871922e92e278f88 Aug 31 00:34:53.238064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-VolumesGetTestJSON-1904409810 Aug 31 00:34:53.238064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-VolumesGetTestJSON-1904409810-project Aug 31 00:34:53.238064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:34:53.238064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:34:53.238064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: d3174cfa2b474a7b90d337a16fe6e522 Aug 31 00:34:53.238064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-VolumesGetTestJSON-1904409810-project Aug 31 00:34:53.238064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: Aug 31 00:34:53.238064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Volume cc871eb3-7fc3-4b84-b36f-633ee874f168 could not be found. Aug 31 00:34:53.238064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': 'cc871eb3-7fc3-4b84-b36f-633ee874f168'} Aug 31 00:34:53.238064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:34:53.238879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:53.238879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:34:53.238879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:34:53.238879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:34:53.238879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:34:53.238879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:34:53.238879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:34:53.238879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:34:53.238879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:34:53.238879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:34:53.238879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:34:53.238879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:34:53.238879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:34:53.238879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:34:53.238879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:34:53.238879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cc871eb3-7fc3-4b84-b36f-633ee874f168 could not be found. (HTTP 404) (Request-ID: req-8eaaeab9-5c33-49fc-ae63-652b12c840b3) Aug 31 00:34:53.238879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:34:53.238879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:34:53.238879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:34:53.239943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:53.239943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 00:34:53.239943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 00:34:53.239943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:34:53.239943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:34:53.239943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:34:53.239943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:34:53.239943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:34:53.239943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:34:53.239943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:34:53.239943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:34:53.239943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:34:53.239943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:34:53.239943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:34:53.239943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:34:53.239943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:34:53.239943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:34:53.239943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:34:53.239943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:34:53.240928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:34:53.240928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:34:53.240928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:34:53.240928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:34:53.240928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cc871eb3-7fc3-4b84-b36f-633ee874f168 could not be found. Aug 31 00:34:53.240928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:34:53.240928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:34:53.240928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:34:53.240928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:53.240928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:34:53.240928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:34:53.240928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:34:53.240928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:34:53.240928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:34:53.240928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:34:53.240928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:34:53.240928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:34:53.240928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 00:34:53.240928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:34:53.242026 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cc871eb3-7fc3-4b84-b36f-633ee874f168 could not be found. Aug 31 00:34:53.242026 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:34:53.242026 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:34:53.242026 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:34:53.242026 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:34:53.242026 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:34:53.242026 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:34:53.242026 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:34:53.242026 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:34:53.242026 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cc871eb3-7fc3-4b84-b36f-633ee874f168 could not be found. Aug 31 00:34:53.242026 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:34:53.242026 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-33ac6960-50f0-4f46-ba5d-e4f654190400 tempest-VolumesGetTestJSON-1904409810 tempest-VolumesGetTestJSON-1904409810-project] Returning 404 to user: Volume cc871eb3-7fc3-4b84-b36f-633ee874f168 could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:34:53.242026 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-33ac6960-50f0-4f46-ba5d-e4f654190400 tempest-VolumesGetTestJSON-1904409810 tempest-VolumesGetTestJSON-1904409810-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/cc871eb3-7fc3-4b84-b36f-633ee874f168" status: 404 len: 109 microversion: 2.1 time: 0.079134 Aug 31 00:34:53.243850 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 4/15] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 00:34:53 2022] GET /compute/v2.1/os-volumes/cc871eb3-7fc3-4b84-b36f-633ee874f168 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:34:57.241122 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8cf80568-76c4-4d9d-bc22-fa3c94e642d7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-788498466", "imageRef": "12947ed8-8ca9-442d-9224-509e79a198e7", "flavorRef": "452", "networks": [{"uuid": "9837c576-c4cf-44ac-87eb-1f546c317c31"}]}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:34:57.437408 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.network.neutron [None req-8cf80568-76c4-4d9d-bc22-fa3c94e642d7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] validate_networks() for [('9837c576-c4cf-44ac-87eb-1f546c317c31', None, None, None, None, None)] {{(pid=128049) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:34:59.153014 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-8cf80568-76c4-4d9d-bc22-fa3c94e642d7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Flavor limits 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:34:59.154107 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-8cf80568-76c4-4d9d-bc22-fa3c94e642d7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Image limits 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:34:59.154779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-8cf80568-76c4-4d9d-bc22-fa3c94e642d7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Flavor pref 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:34:59.155660 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-8cf80568-76c4-4d9d-bc22-fa3c94e642d7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Image pref 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:34:59.156782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-8cf80568-76c4-4d9d-bc22-fa3c94e642d7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:34:59.189966 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8cf80568-76c4-4d9d-bc22-fa3c94e642d7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:34:59.191055 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8cf80568-76c4-4d9d-bc22-fa3c94e642d7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:34:59.191664 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8cf80568-76c4-4d9d-bc22-fa3c94e642d7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:34:59.193238 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8cf80568-76c4-4d9d-bc22-fa3c94e642d7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:34:59.194431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8cf80568-76c4-4d9d-bc22-fa3c94e642d7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:34:59.195869 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8cf80568-76c4-4d9d-bc22-fa3c94e642d7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:34:59.267813 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-8cf80568-76c4-4d9d-bc22-fa3c94e642d7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Getting quotas for project c0528602037241c98f36d12984aa26a9. Resources: {'ram', 'cores', 'instances'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:34:59.291481 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-8cf80568-76c4-4d9d-bc22-fa3c94e642d7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Getting quotas for user 703b8e63fa4449dfb85de594a8d2e5fe and project c0528602037241c98f36d12984aa26a9. Resources: {'ram', 'cores', 'instances'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:34:59.342107 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8cf80568-76c4-4d9d-bc22-fa3c94e642d7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Going to run 1 instances... {{(pid=128049) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:34:59.357087 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8cf80568-76c4-4d9d-bc22-fa3c94e642d7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12947ed8-8ca9-442d-9224-509e79a198e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:34:59.681796 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8cf80568-76c4-4d9d-bc22-fa3c94e642d7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.728574 Aug 31 00:34:59.686210 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 12/16] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:34:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:34:59.698865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ed23181f-7219-4143-9568-98dd2ed188e1 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:34:59.699688 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ed23181f-7219-4143-9568-98dd2ed188e1 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:34:59.948172 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ed23181f-7219-4143-9568-98dd2ed188e1 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:34:59.974567 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ed23181f-7219-4143-9568-98dd2ed188e1 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1214 microversion: 2.1 time: 0.281003 Aug 31 00:34:59.991366 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 5/17] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:34:59 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1214 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:01.000175 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-10489f81-9b10-4916-916c-22e709ac4bc0 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:01.000839 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-10489f81-9b10-4916-916c-22e709ac4bc0 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:01.179795 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-10489f81-9b10-4916-916c-22e709ac4bc0 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:01.194117 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-10489f81-9b10-4916-916c-22e709ac4bc0 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1214 microversion: 2.1 time: 0.201430 Aug 31 00:35:01.196702 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 6/18] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:00 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:01.355335 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-2635dfc0-9788-41f2-a15d-279e15a45fd8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1144428468", "imageRef": "12947ed8-8ca9-442d-9224-509e79a198e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:35:01.552139 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.network.neutron [None req-2635dfc0-9788-41f2-a15d-279e15a45fd8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] validate_networks() for [('578f7ed4-d51e-4ddc-a46f-3229f20b75ab', None, None, None, None, None)] {{(pid=128049) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:35:02.218046 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-842c8b1e-8ada-4e12-90bf-51bc944d1bf4 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:02.218965 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-842c8b1e-8ada-4e12-90bf-51bc944d1bf4 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:02.441358 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-842c8b1e-8ada-4e12-90bf-51bc944d1bf4 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:02.451483 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-842c8b1e-8ada-4e12-90bf-51bc944d1bf4 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1214 microversion: 2.1 time: 0.237174 Aug 31 00:35:02.455682 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 7/19] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:02 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1214 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:03.472807 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-87831c83-c61d-4d96-92a1-ce5e3e3e20cb tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:03.474238 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-87831c83-c61d-4d96-92a1-ce5e3e3e20cb tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:03.488166 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-87831c83-c61d-4d96-92a1-ce5e3e3e20cb tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:03.490558 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-87831c83-c61d-4d96-92a1-ce5e3e3e20cb tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:03.492204 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-87831c83-c61d-4d96-92a1-ce5e3e3e20cb tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:03.496498 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-87831c83-c61d-4d96-92a1-ce5e3e3e20cb tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:03.496931 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-87831c83-c61d-4d96-92a1-ce5e3e3e20cb tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:03.497376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-87831c83-c61d-4d96-92a1-ce5e3e3e20cb tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:03.943755 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-87831c83-c61d-4d96-92a1-ce5e3e3e20cb tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:03.981389 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-87831c83-c61d-4d96-92a1-ce5e3e3e20cb tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1218 microversion: 2.1 time: 0.505840 Aug 31 00:35:03.988891 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 8/20] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:03 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1218 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:04.057426 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-2635dfc0-9788-41f2-a15d-279e15a45fd8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Flavor limits 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:35:04.057426 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-2635dfc0-9788-41f2-a15d-279e15a45fd8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Image limits 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:35:04.057954 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-2635dfc0-9788-41f2-a15d-279e15a45fd8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Flavor pref 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:35:04.058248 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-2635dfc0-9788-41f2-a15d-279e15a45fd8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Image pref 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:35:04.058952 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-2635dfc0-9788-41f2-a15d-279e15a45fd8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:35:04.077291 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2635dfc0-9788-41f2-a15d-279e15a45fd8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:04.078865 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2635dfc0-9788-41f2-a15d-279e15a45fd8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:04.079467 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2635dfc0-9788-41f2-a15d-279e15a45fd8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:04.080913 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2635dfc0-9788-41f2-a15d-279e15a45fd8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:04.086095 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2635dfc0-9788-41f2-a15d-279e15a45fd8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:04.086095 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2635dfc0-9788-41f2-a15d-279e15a45fd8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:04.131329 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-2635dfc0-9788-41f2-a15d-279e15a45fd8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Getting quotas for project d8aa6e0e8e6b492f8e74eea0e830c0bc. Resources: {'ram', 'cores', 'instances'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:35:04.138185 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-2635dfc0-9788-41f2-a15d-279e15a45fd8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Getting quotas for user 77d23c99308c414f939761b07d329e03 and project d8aa6e0e8e6b492f8e74eea0e830c0bc. Resources: {'ram', 'cores', 'instances'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:35:04.156295 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-2635dfc0-9788-41f2-a15d-279e15a45fd8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Going to run 1 instances... {{(pid=128049) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:35:04.158848 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-2635dfc0-9788-41f2-a15d-279e15a45fd8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12947ed8-8ca9-442d-9224-509e79a198e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:35:04.410094 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-2635dfc0-9788-41f2-a15d-279e15a45fd8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.623558 Aug 31 00:35:04.423573 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 13/21] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:35:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 3638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:35:04.436664 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-478d1b7c-ba34-4642-9c0d-3fc180ff611e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:04.436664 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-478d1b7c-ba34-4642-9c0d-3fc180ff611e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:04.636858 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-478d1b7c-ba34-4642-9c0d-3fc180ff611e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:04.643961 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-478d1b7c-ba34-4642-9c0d-3fc180ff611e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1222 microversion: 2.1 time: 0.224413 Aug 31 00:35:04.679455 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 9/22] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:04 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1222 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:04.949076 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-76acb74b-d309-4e1a-ae13-d3efdf0084df tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-878654173", "imageRef": "12947ed8-8ca9-442d-9224-509e79a198e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:35:05.003007 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-41fbc6d0-264b-4453-a613-f1094a625c85 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:05.003950 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-41fbc6d0-264b-4453-a613-f1094a625c85 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:05.016755 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-41fbc6d0-264b-4453-a613-f1094a625c85 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:05.021672 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-41fbc6d0-264b-4453-a613-f1094a625c85 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:05.022305 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-41fbc6d0-264b-4453-a613-f1094a625c85 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:05.027179 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-41fbc6d0-264b-4453-a613-f1094a625c85 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:05.033814 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-41fbc6d0-264b-4453-a613-f1094a625c85 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:05.034312 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-41fbc6d0-264b-4453-a613-f1094a625c85 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:05.105417 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.network.neutron [None req-76acb74b-d309-4e1a-ae13-d3efdf0084df tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] validate_networks() for [('578f7ed4-d51e-4ddc-a46f-3229f20b75ab', None, None, None, None, None)] {{(pid=128049) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:35:05.271409 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-41fbc6d0-264b-4453-a613-f1094a625c85 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:05.322922 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-41fbc6d0-264b-4453-a613-f1094a625c85 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1266 microversion: 2.1 time: 0.323895 Aug 31 00:35:05.323775 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 10/23] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:04 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1266 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:05.762409 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-27dee47c-8fc8-4ede-88a2-03e86b01fc03 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Action: 'create', calling method: .version_select at 0x7f551f7b9790>, body: {"keypair": {"name": "tempest-keypair-1024814370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPSQ76eO+1oVFNJInJVvICEJjUQaLC2CGuj+1MZKmgrJFZXkjho/gn0tmvIOwsKvLIZpCDJvMtlXaVs6iRXiYjBMNc/NC3p0y5HE5u54oazhio/RFHamQCKgbcDYUFxhw=="}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:35:05.910618 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-27dee47c-8fc8-4ede-88a2-03e86b01fc03 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Getting quotas for project 606c24bee18a4454ab672cfb6a395286. Resources: {'key_pairs'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:35:05.925359 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-27dee47c-8fc8-4ede-88a2-03e86b01fc03 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Getting quotas for user 2a927401086b4a649919a6071b4a0fd9 and project 606c24bee18a4454ab672cfb6a395286. Resources: {'key_pairs'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:35:06.160996 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-27dee47c-8fc8-4ede-88a2-03e86b01fc03 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.700379 Aug 31 00:35:06.162301 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 11/24] 10.222.0.65 () {62 vars in 1200 bytes} [Wed Aug 31 00:35:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 703 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 31 00:35:06.350679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-1a761420-ae17-47bc-a657-4eb5f1abec23 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:06.351694 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-1a761420-ae17-47bc-a657-4eb5f1abec23 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:06.371981 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1a761420-ae17-47bc-a657-4eb5f1abec23 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:06.379974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1a761420-ae17-47bc-a657-4eb5f1abec23 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:06.380612 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1a761420-ae17-47bc-a657-4eb5f1abec23 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:06.388585 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1a761420-ae17-47bc-a657-4eb5f1abec23 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:06.389305 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1a761420-ae17-47bc-a657-4eb5f1abec23 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:06.390920 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1a761420-ae17-47bc-a657-4eb5f1abec23 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:06.801337 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-1a761420-ae17-47bc-a657-4eb5f1abec23 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:06.814351 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-1a761420-ae17-47bc-a657-4eb5f1abec23 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1284 microversion: 2.1 time: 0.465130 Aug 31 00:35:06.816771 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 12/25] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:06 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1284 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:07.484354 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-76acb74b-d309-4e1a-ae13-d3efdf0084df tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Flavor limits 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:35:07.484858 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-76acb74b-d309-4e1a-ae13-d3efdf0084df tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Image limits 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:35:07.485285 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-76acb74b-d309-4e1a-ae13-d3efdf0084df tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Flavor pref 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:35:07.485963 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-76acb74b-d309-4e1a-ae13-d3efdf0084df tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Image pref 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:35:07.486435 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-76acb74b-d309-4e1a-ae13-d3efdf0084df tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:35:07.517277 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-76acb74b-d309-4e1a-ae13-d3efdf0084df tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:07.517648 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-76acb74b-d309-4e1a-ae13-d3efdf0084df tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:07.518083 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-76acb74b-d309-4e1a-ae13-d3efdf0084df tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:07.524829 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-76acb74b-d309-4e1a-ae13-d3efdf0084df tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:07.532040 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-76acb74b-d309-4e1a-ae13-d3efdf0084df tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:07.533380 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-76acb74b-d309-4e1a-ae13-d3efdf0084df tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:07.633041 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-76acb74b-d309-4e1a-ae13-d3efdf0084df tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Getting quotas for project d8aa6e0e8e6b492f8e74eea0e830c0bc. Resources: {'ram', 'cores', 'instances'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:35:07.653349 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-76acb74b-d309-4e1a-ae13-d3efdf0084df tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Getting quotas for user 77d23c99308c414f939761b07d329e03 and project d8aa6e0e8e6b492f8e74eea0e830c0bc. Resources: {'ram', 'cores', 'instances'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:35:07.732286 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-76acb74b-d309-4e1a-ae13-d3efdf0084df tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Going to run 1 instances... {{(pid=128049) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:35:07.756181 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-76acb74b-d309-4e1a-ae13-d3efdf0084df tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12947ed8-8ca9-442d-9224-509e79a198e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:35:08.022500 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-76acb74b-d309-4e1a-ae13-d3efdf0084df tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.078619 Aug 31 00:35:08.023200 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 14/26] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:35:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 3080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:35:08.038588 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-7b7fbbc5-bfee-4575-95d3-91f1b460e4ab tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:08.044840 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-7b7fbbc5-bfee-4575-95d3-91f1b460e4ab tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:08.134208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7b7fbbc5-bfee-4575-95d3-91f1b460e4ab tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:08.136929 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7b7fbbc5-bfee-4575-95d3-91f1b460e4ab tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:08.137622 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7b7fbbc5-bfee-4575-95d3-91f1b460e4ab tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:08.139687 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7b7fbbc5-bfee-4575-95d3-91f1b460e4ab tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:08.147010 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7b7fbbc5-bfee-4575-95d3-91f1b460e4ab tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:08.166259 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7b7fbbc5-bfee-4575-95d3-91f1b460e4ab tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:08.553801 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-07e6a1a8-6106-4765-b9bf-9e52fc3e878c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Action: 'create', calling method: .version_select at 0x7f551f7cb4c0>, body: {"keypair": {"name": "tempest-keypair-1774872595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1gnFK4ux0jnLDAtMBXunFgpnaLWCFXNErqpu9LWfDT101buoC8nT7KNb0uZgj0DERDidOOidtwFdThJ6k99l0BtBs5yeI+Qfh4Ix/Ysmnc0kqXZLm7aJ9Y0m+yCr5m1A=="}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:35:08.606379 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-07e6a1a8-6106-4765-b9bf-9e52fc3e878c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Getting quotas for project ec5893d9a55f4ed28f6579397d0d6f21. Resources: {'key_pairs'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:35:08.637492 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-07e6a1a8-6106-4765-b9bf-9e52fc3e878c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Getting quotas for user 45422a67a78f4784abc0f18ad84778f3 and project ec5893d9a55f4ed28f6579397d0d6f21. Resources: {'key_pairs'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:35:08.811370 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-07e6a1a8-6106-4765-b9bf-9e52fc3e878c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.014838 Aug 31 00:35:08.820423 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 13/27] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 00:35:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:35:08.828713 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-26dd8153-966a-40fd-bcd6-20ce255c4645 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:08.831992 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-26dd8153-966a-40fd-bcd6-20ce255c4645 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:09.086169 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-26dd8153-966a-40fd-bcd6-20ce255c4645 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:09.103532 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-26dd8153-966a-40fd-bcd6-20ce255c4645 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1221 microversion: 2.1 time: 0.280284 Aug 31 00:35:09.108280 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 14/28] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:08 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1221 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:10.037639 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7b7fbbc5-bfee-4575-95d3-91f1b460e4ab tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:10.132293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-7b7fbbc5-bfee-4575-95d3-91f1b460e4ab tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 2.104651 Aug 31 00:35:10.137276 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 15/29] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:08 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 2114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:10.160938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-5b1b943c-cb52-4e50-9349-280c6674a7aa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:10.172641 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-5b1b943c-cb52-4e50-9349-280c6674a7aa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:10.216705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5b1b943c-cb52-4e50-9349-280c6674a7aa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:10.218776 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5b1b943c-cb52-4e50-9349-280c6674a7aa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:10.221799 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5b1b943c-cb52-4e50-9349-280c6674a7aa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:10.223959 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5b1b943c-cb52-4e50-9349-280c6674a7aa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:10.229043 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5b1b943c-cb52-4e50-9349-280c6674a7aa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:10.231401 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5b1b943c-cb52-4e50-9349-280c6674a7aa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:10.552447 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-5b1b943c-cb52-4e50-9349-280c6674a7aa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:10.598870 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-5b1b943c-cb52-4e50-9349-280c6674a7aa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1225 microversion: 2.1 time: 0.469397 Aug 31 00:35:10.619886 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 15/30] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:10 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1225 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:11.164070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b6cbaeeb-3884-4302-8141-b82f2553e37a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:11.165067 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-b6cbaeeb-3884-4302-8141-b82f2553e37a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:11.190129 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b6cbaeeb-3884-4302-8141-b82f2553e37a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:11.193949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b6cbaeeb-3884-4302-8141-b82f2553e37a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:11.197303 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b6cbaeeb-3884-4302-8141-b82f2553e37a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:11.205216 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b6cbaeeb-3884-4302-8141-b82f2553e37a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:11.205880 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b6cbaeeb-3884-4302-8141-b82f2553e37a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:11.209327 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b6cbaeeb-3884-4302-8141-b82f2553e37a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:11.634445 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-8ad1c80a-df9d-4303-8078-026369ef3750 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:11.636088 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-8ad1c80a-df9d-4303-8078-026369ef3750 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:11.655502 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ad1c80a-df9d-4303-8078-026369ef3750 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:11.656057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ad1c80a-df9d-4303-8078-026369ef3750 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:11.660220 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ad1c80a-df9d-4303-8078-026369ef3750 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:11.662309 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ad1c80a-df9d-4303-8078-026369ef3750 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:11.662892 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ad1c80a-df9d-4303-8078-026369ef3750 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:11.663234 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ad1c80a-df9d-4303-8078-026369ef3750 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:12.210695 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-b6cbaeeb-3884-4302-8141-b82f2553e37a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:12.240267 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-b6cbaeeb-3884-4302-8141-b82f2553e37a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 1.079515 Aug 31 00:35:12.257346 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 16/31] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:11 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:12.355455 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-8ad1c80a-df9d-4303-8078-026369ef3750 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:12.370558 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-8ad1c80a-df9d-4303-8078-026369ef3750 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1273 microversion: 2.1 time: 0.745198 Aug 31 00:35:12.375493 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 16/32] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:11 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1273 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:13.269386 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-770a21d3-4d73-4b2b-8811-2f3c241640d5 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:13.270668 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-770a21d3-4d73-4b2b-8811-2f3c241640d5 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:13.284602 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-770a21d3-4d73-4b2b-8811-2f3c241640d5 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:13.286957 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-770a21d3-4d73-4b2b-8811-2f3c241640d5 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:13.286957 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-770a21d3-4d73-4b2b-8811-2f3c241640d5 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:13.302766 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-770a21d3-4d73-4b2b-8811-2f3c241640d5 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:13.305551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-770a21d3-4d73-4b2b-8811-2f3c241640d5 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:13.312011 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-770a21d3-4d73-4b2b-8811-2f3c241640d5 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:13.396208 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-54c1ebba-44f2-447b-a0b3-090325b350b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:13.403295 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-54c1ebba-44f2-447b-a0b3-090325b350b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:13.438026 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-54c1ebba-44f2-447b-a0b3-090325b350b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:13.442262 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-54c1ebba-44f2-447b-a0b3-090325b350b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:13.447803 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-54c1ebba-44f2-447b-a0b3-090325b350b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:13.448666 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-54c1ebba-44f2-447b-a0b3-090325b350b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:13.453425 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-54c1ebba-44f2-447b-a0b3-090325b350b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:13.454029 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-54c1ebba-44f2-447b-a0b3-090325b350b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:14.243985 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-770a21d3-4d73-4b2b-8811-2f3c241640d5 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:14.265222 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-770a21d3-4d73-4b2b-8811-2f3c241640d5 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.999810 Aug 31 00:35:14.265828 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 17/33] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:13 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:14.818053 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-54c1ebba-44f2-447b-a0b3-090325b350b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:14.832868 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-54c1ebba-44f2-447b-a0b3-090325b350b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1279 microversion: 2.1 time: 1.441406 Aug 31 00:35:14.833920 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 17/34] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:13 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1279 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:15.370641 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f9815340-57bb-4542-9030-fa44da3508ea tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:15.370641 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f9815340-57bb-4542-9030-fa44da3508ea tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:15.370641 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9815340-57bb-4542-9030-fa44da3508ea tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:15.370641 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9815340-57bb-4542-9030-fa44da3508ea tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:15.371330 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9815340-57bb-4542-9030-fa44da3508ea tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:15.371330 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9815340-57bb-4542-9030-fa44da3508ea tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:15.371330 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9815340-57bb-4542-9030-fa44da3508ea tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:15.371330 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9815340-57bb-4542-9030-fa44da3508ea tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:15.564632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f9815340-57bb-4542-9030-fa44da3508ea tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:15.573564 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f9815340-57bb-4542-9030-fa44da3508ea tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.289840 Aug 31 00:35:15.574138 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 18/35] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:15 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:15.856164 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-b49e3764-078f-4d30-9f2f-fb9d2a0828db tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:15.857008 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-b49e3764-078f-4d30-9f2f-fb9d2a0828db tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:15.872342 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b49e3764-078f-4d30-9f2f-fb9d2a0828db tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:15.872855 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b49e3764-078f-4d30-9f2f-fb9d2a0828db tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:15.873283 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b49e3764-078f-4d30-9f2f-fb9d2a0828db tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:15.888126 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b49e3764-078f-4d30-9f2f-fb9d2a0828db tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:15.888126 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b49e3764-078f-4d30-9f2f-fb9d2a0828db tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:15.888126 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b49e3764-078f-4d30-9f2f-fb9d2a0828db tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:16.605072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f222e6d5-4037-4594-9b8c-ff5e5f18b8ec tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:16.606369 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f222e6d5-4037-4594-9b8c-ff5e5f18b8ec tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:16.622660 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f222e6d5-4037-4594-9b8c-ff5e5f18b8ec tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:16.623156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f222e6d5-4037-4594-9b8c-ff5e5f18b8ec tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:16.630660 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f222e6d5-4037-4594-9b8c-ff5e5f18b8ec tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:16.635047 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f222e6d5-4037-4594-9b8c-ff5e5f18b8ec tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:16.635971 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f222e6d5-4037-4594-9b8c-ff5e5f18b8ec tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:16.636588 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f222e6d5-4037-4594-9b8c-ff5e5f18b8ec tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:16.980208 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b49e3764-078f-4d30-9f2f-fb9d2a0828db tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:17.022284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-b49e3764-078f-4d30-9f2f-fb9d2a0828db tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1279 microversion: 2.1 time: 1.170953 Aug 31 00:35:17.028464 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 18/36] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:15 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1279 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:17.221670 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f222e6d5-4037-4594-9b8c-ff5e5f18b8ec tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:17.231699 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f222e6d5-4037-4594-9b8c-ff5e5f18b8ec tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.634776 Aug 31 00:35:17.238353 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 19/37] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:16 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:18.051469 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-bc273549-86f4-4bbc-a9d3-e703271bc182 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:18.052804 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-bc273549-86f4-4bbc-a9d3-e703271bc182 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:18.066481 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bc273549-86f4-4bbc-a9d3-e703271bc182 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:18.067873 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bc273549-86f4-4bbc-a9d3-e703271bc182 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:18.068466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bc273549-86f4-4bbc-a9d3-e703271bc182 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:18.073321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bc273549-86f4-4bbc-a9d3-e703271bc182 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:18.074095 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bc273549-86f4-4bbc-a9d3-e703271bc182 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:18.079545 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bc273549-86f4-4bbc-a9d3-e703271bc182 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:18.268702 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3f3e783c-ff85-4ce1-b50b-8c42b568953d tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:18.270553 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-3f3e783c-ff85-4ce1-b50b-8c42b568953d tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:18.274462 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=6 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:35:18.276126 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=18 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:35:18.284264 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3f3e783c-ff85-4ce1-b50b-8c42b568953d tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:18.285132 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3f3e783c-ff85-4ce1-b50b-8c42b568953d tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:18.286282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3f3e783c-ff85-4ce1-b50b-8c42b568953d tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:18.287760 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3f3e783c-ff85-4ce1-b50b-8c42b568953d tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:18.288918 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3f3e783c-ff85-4ce1-b50b-8c42b568953d tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:18.290013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3f3e783c-ff85-4ce1-b50b-8c42b568953d tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:18.584949 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-bc273549-86f4-4bbc-a9d3-e703271bc182 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:18.602287 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-bc273549-86f4-4bbc-a9d3-e703271bc182 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1279 microversion: 2.1 time: 0.553729 Aug 31 00:35:18.602927 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 19/38] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:18 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1279 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:18.623883 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c5b824d1-3dc1-42d8-acd0-caa374e95dd9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-463038797", "imageRef": "12947ed8-8ca9-442d-9224-509e79a198e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd1dfc05-b842-4c55-a9f4-0aefefbafd0b"}], "security_groups": [{"name": "tempest-securitygroup--828040641"}], "key_name": "tempest-keypair-1024814370", "user_data": "}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:35:18.673468 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-3f3e783c-ff85-4ce1-b50b-8c42b568953d tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:18.690517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-3f3e783c-ff85-4ce1-b50b-8c42b568953d tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.423809 Aug 31 00:35:18.706709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 20/39] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:18 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:19.099732 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=18 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:35:19.627310 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.network.neutron [None req-c5b824d1-3dc1-42d8-acd0-caa374e95dd9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] validate_networks() for [('dd1dfc05-b842-4c55-a9f4-0aefefbafd0b', None, None, None, None, None)] {{(pid=128048) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:35:19.731326 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-596739aa-ac1e-4150-8acb-51734d409f8c req-b35ed0db-ed7c-4594-9955-e9e13471d600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31dd6cf1-78b5-438d-95ce-aa6229958298", "tag": "6033d17d-748b-4a2e-b40d-29f917390834"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:35:19.768874 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-596739aa-ac1e-4150-8acb-51734d409f8c req-b35ed0db-ed7c-4594-9955-e9e13471d600 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:19.770725 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-596739aa-ac1e-4150-8acb-51734d409f8c req-b35ed0db-ed7c-4594-9955-e9e13471d600 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:19.772038 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-596739aa-ac1e-4150-8acb-51734d409f8c req-b35ed0db-ed7c-4594-9955-e9e13471d600 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:19.816658 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-596739aa-ac1e-4150-8acb-51734d409f8c req-b35ed0db-ed7c-4594-9955-e9e13471d600 service nova] Creating event network-changed:6033d17d-748b-4a2e-b40d-29f917390834 for instance 31dd6cf1-78b5-438d-95ce-aa6229958298 on hv-cinder-85221 Aug 31 00:35:19.817430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-596739aa-ac1e-4150-8acb-51734d409f8c req-b35ed0db-ed7c-4594-9955-e9e13471d600 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128049) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 00:35:19.818213 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-596739aa-ac1e-4150-8acb-51734d409f8c req-b35ed0db-ed7c-4594-9955-e9e13471d600 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128049) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 00:35:19.819747 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-116b8754-bac1-4aa2-a7a7-c094cc9c5305 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:19.821864 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-116b8754-bac1-4aa2-a7a7-c094cc9c5305 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:19.823321 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-116b8754-bac1-4aa2-a7a7-c094cc9c5305 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:19.828585 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-116b8754-bac1-4aa2-a7a7-c094cc9c5305 None None] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:19.829534 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-116b8754-bac1-4aa2-a7a7-c094cc9c5305 None None] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:19.830292 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-116b8754-bac1-4aa2-a7a7-c094cc9c5305 None None] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:19.841181 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.compute.rpcapi [None req-116b8754-bac1-4aa2-a7a7-c094cc9c5305 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 00:35:19.842503 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-116b8754-bac1-4aa2-a7a7-c094cc9c5305 None None] Releasing lock "compute-rpcapi-router" {{(pid=128049) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 00:35:19.870197 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-116b8754-bac1-4aa2-a7a7-c094cc9c5305 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.271863 Aug 31 00:35:19.873235 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 21/40] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:35:19.886191 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-bd04f925-9853-4cbd-aac4-41fcc608ad65 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:19.891570 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-bd04f925-9853-4cbd-aac4-41fcc608ad65 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:19.910384 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd04f925-9853-4cbd-aac4-41fcc608ad65 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:19.912770 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd04f925-9853-4cbd-aac4-41fcc608ad65 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:19.915615 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd04f925-9853-4cbd-aac4-41fcc608ad65 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:19.918065 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd04f925-9853-4cbd-aac4-41fcc608ad65 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:19.918957 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd04f925-9853-4cbd-aac4-41fcc608ad65 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:19.921247 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd04f925-9853-4cbd-aac4-41fcc608ad65 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:20.025601 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-bd04f925-9853-4cbd-aac4-41fcc608ad65 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:20.048271 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-bd04f925-9853-4cbd-aac4-41fcc608ad65 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1279 microversion: 2.1 time: 0.175662 Aug 31 00:35:20.061523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 22/41] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:19 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1279 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:20.061523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4877a069-63de-4ccf-a8b8-b8b8077ef07a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:20.061523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4877a069-63de-4ccf-a8b8-b8b8077ef07a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:20.065858 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4877a069-63de-4ccf-a8b8-b8b8077ef07a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:20.066703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4877a069-63de-4ccf-a8b8-b8b8077ef07a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:20.067413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4877a069-63de-4ccf-a8b8-b8b8077ef07a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:20.069548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4877a069-63de-4ccf-a8b8-b8b8077ef07a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:20.071075 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4877a069-63de-4ccf-a8b8-b8b8077ef07a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:20.071891 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4877a069-63de-4ccf-a8b8-b8b8077ef07a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:20.639341 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4877a069-63de-4ccf-a8b8-b8b8077ef07a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:20.665933 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4877a069-63de-4ccf-a8b8-b8b8077ef07a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.610029 Aug 31 00:35:20.672405 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 23/42] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:20 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:20.706356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8f046996-458f-46ce-a273-34152258b9a0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1725012713", "imageRef": "12947ed8-8ca9-442d-9224-509e79a198e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d427232-8e26-4216-9399-96dea4f30f86"}], "security_groups": [{"name": "tempest-securitygroup--1063148606"}], "key_name": "tempest-keypair-1774872595", "user_data": "}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:35:20.941853 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.network.neutron [None req-8f046996-458f-46ce-a273-34152258b9a0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] validate_networks() for [('6d427232-8e26-4216-9399-96dea4f30f86', None, None, None, None, None)] {{(pid=128049) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:35:22.131465 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-8f046996-458f-46ce-a273-34152258b9a0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Flavor limits 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:35:22.132199 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-8f046996-458f-46ce-a273-34152258b9a0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Image limits 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:35:22.133412 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-8f046996-458f-46ce-a273-34152258b9a0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Flavor pref 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:35:22.134061 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-8f046996-458f-46ce-a273-34152258b9a0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Image pref 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:35:22.134820 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-8f046996-458f-46ce-a273-34152258b9a0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:35:22.163870 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8f046996-458f-46ce-a273-34152258b9a0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:22.169372 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8f046996-458f-46ce-a273-34152258b9a0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:22.172680 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8f046996-458f-46ce-a273-34152258b9a0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:22.173809 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8f046996-458f-46ce-a273-34152258b9a0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:22.174569 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8f046996-458f-46ce-a273-34152258b9a0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:22.175229 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8f046996-458f-46ce-a273-34152258b9a0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:22.202454 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-8f046996-458f-46ce-a273-34152258b9a0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Getting quotas for project ec5893d9a55f4ed28f6579397d0d6f21. Resources: {'ram', 'cores', 'instances'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:35:22.208732 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-8f046996-458f-46ce-a273-34152258b9a0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Getting quotas for user 45422a67a78f4784abc0f18ad84778f3 and project ec5893d9a55f4ed28f6579397d0d6f21. Resources: {'ram', 'cores', 'instances'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:35:22.229466 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8f046996-458f-46ce-a273-34152258b9a0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Going to run 1 instances... {{(pid=128049) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:35:22.234889 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8f046996-458f-46ce-a273-34152258b9a0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12947ed8-8ca9-442d-9224-509e79a198e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:35:22.619450 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8f046996-458f-46ce-a273-34152258b9a0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.945503 Aug 31 00:35:22.620617 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 24/43] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:35:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:35:22.636381 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-2f7594c4-88ff-4bed-897d-e09affa755f4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:22.637131 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-2f7594c4-88ff-4bed-897d-e09affa755f4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:22.645802 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2f7594c4-88ff-4bed-897d-e09affa755f4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:22.646473 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2f7594c4-88ff-4bed-897d-e09affa755f4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:22.647085 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2f7594c4-88ff-4bed-897d-e09affa755f4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:22.649141 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2f7594c4-88ff-4bed-897d-e09affa755f4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:22.650022 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2f7594c4-88ff-4bed-897d-e09affa755f4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:22.657152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2f7594c4-88ff-4bed-897d-e09affa755f4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:22.933481 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-2f7594c4-88ff-4bed-897d-e09affa755f4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:22.942414 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-2f7594c4-88ff-4bed-897d-e09affa755f4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.320371 Aug 31 00:35:22.943029 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 25/44] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:22 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:22.950382 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-5b4b2648-7376-41bc-b66d-be1701d746c6 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:22.951148 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-5b4b2648-7376-41bc-b66d-be1701d746c6 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:22.960185 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5b4b2648-7376-41bc-b66d-be1701d746c6 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:22.962047 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5b4b2648-7376-41bc-b66d-be1701d746c6 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:22.968621 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5b4b2648-7376-41bc-b66d-be1701d746c6 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:22.968621 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5b4b2648-7376-41bc-b66d-be1701d746c6 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:22.968621 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5b4b2648-7376-41bc-b66d-be1701d746c6 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:22.968621 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5b4b2648-7376-41bc-b66d-be1701d746c6 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:23.232944 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-5b4b2648-7376-41bc-b66d-be1701d746c6 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:23.262028 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-5b4b2648-7376-41bc-b66d-be1701d746c6 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.315484 Aug 31 00:35:23.279707 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 26/45] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:22 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:23.294819 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-d6b12f99-d872-459c-a9b2-198a61d68b6f req-d10454b9-6c77-48cf-95c7-407d380fedc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e71a61bc-1bd8-4191-96c6-7f7e2e4db485", "tag": "ba4bd26f-64e9-4863-a592-ab685b279ebe"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:35:23.314634 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-d6b12f99-d872-459c-a9b2-198a61d68b6f req-d10454b9-6c77-48cf-95c7-407d380fedc6 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:23.327740 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-d6b12f99-d872-459c-a9b2-198a61d68b6f req-d10454b9-6c77-48cf-95c7-407d380fedc6 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:23.329651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-d6b12f99-d872-459c-a9b2-198a61d68b6f req-d10454b9-6c77-48cf-95c7-407d380fedc6 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:23.354010 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-d6b12f99-d872-459c-a9b2-198a61d68b6f req-d10454b9-6c77-48cf-95c7-407d380fedc6 service nova] Creating event network-changed:ba4bd26f-64e9-4863-a592-ab685b279ebe for instance e71a61bc-1bd8-4191-96c6-7f7e2e4db485 on hv-cinder-85221 Aug 31 00:35:23.378061 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-d6b12f99-d872-459c-a9b2-198a61d68b6f req-d10454b9-6c77-48cf-95c7-407d380fedc6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092758 Aug 31 00:35:23.378661 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 27/46] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:35:23.393052 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-7e2d2d4f-1955-4fec-a7fc-e0651161eeb8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:23.393804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-7e2d2d4f-1955-4fec-a7fc-e0651161eeb8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:23.563118 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7e2d2d4f-1955-4fec-a7fc-e0651161eeb8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:23.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-7e2d2d4f-1955-4fec-a7fc-e0651161eeb8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1242 microversion: 2.1 time: 0.203121 Aug 31 00:35:23.589250 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 28/47] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:23 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1242 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:23.980403 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-bd430db8-7b13-4fb5-b199-fbc62b556a44 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:23.981012 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-bd430db8-7b13-4fb5-b199-fbc62b556a44 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:23.992515 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd430db8-7b13-4fb5-b199-fbc62b556a44 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:23.993120 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd430db8-7b13-4fb5-b199-fbc62b556a44 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:23.993558 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd430db8-7b13-4fb5-b199-fbc62b556a44 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:24.024266 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd430db8-7b13-4fb5-b199-fbc62b556a44 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:24.028138 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd430db8-7b13-4fb5-b199-fbc62b556a44 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:24.030403 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd430db8-7b13-4fb5-b199-fbc62b556a44 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:24.442320 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-bd430db8-7b13-4fb5-b199-fbc62b556a44 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:24.452929 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-bd430db8-7b13-4fb5-b199-fbc62b556a44 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.476781 Aug 31 00:35:24.455156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 29/48] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:23 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:24.460693 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f648209a-3c2b-4b2a-962c-3d2e3e037ef9 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:24.462133 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f648209a-3c2b-4b2a-962c-3d2e3e037ef9 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:24.469920 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f648209a-3c2b-4b2a-962c-3d2e3e037ef9 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:24.470672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f648209a-3c2b-4b2a-962c-3d2e3e037ef9 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:24.471251 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f648209a-3c2b-4b2a-962c-3d2e3e037ef9 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:24.474470 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f648209a-3c2b-4b2a-962c-3d2e3e037ef9 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:24.474470 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f648209a-3c2b-4b2a-962c-3d2e3e037ef9 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:24.474470 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f648209a-3c2b-4b2a-962c-3d2e3e037ef9 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:24.683322 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-c5b824d1-3dc1-42d8-acd0-caa374e95dd9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Flavor limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:35:24.687562 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-c5b824d1-3dc1-42d8-acd0-caa374e95dd9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Image limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:35:24.688848 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-c5b824d1-3dc1-42d8-acd0-caa374e95dd9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Flavor pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:35:24.689669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-c5b824d1-3dc1-42d8-acd0-caa374e95dd9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Image pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:35:24.690804 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-c5b824d1-3dc1-42d8-acd0-caa374e95dd9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:35:24.719149 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c5b824d1-3dc1-42d8-acd0-caa374e95dd9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:24.719640 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c5b824d1-3dc1-42d8-acd0-caa374e95dd9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:24.720073 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c5b824d1-3dc1-42d8-acd0-caa374e95dd9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:24.721618 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c5b824d1-3dc1-42d8-acd0-caa374e95dd9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:24.728049 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c5b824d1-3dc1-42d8-acd0-caa374e95dd9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:24.729273 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c5b824d1-3dc1-42d8-acd0-caa374e95dd9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:24.745878 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f648209a-3c2b-4b2a-962c-3d2e3e037ef9 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:24.755667 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f648209a-3c2b-4b2a-962c-3d2e3e037ef9 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.298708 Aug 31 00:35:24.756813 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 30/49] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:24 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:24.762564 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-78249e72-bfe0-4422-aefc-e20f841bb1e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:24.763444 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-78249e72-bfe0-4422-aefc-e20f841bb1e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:24.767450 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:35:24.773481 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-78249e72-bfe0-4422-aefc-e20f841bb1e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:24.774191 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-78249e72-bfe0-4422-aefc-e20f841bb1e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:24.780127 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-78249e72-bfe0-4422-aefc-e20f841bb1e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:24.780127 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-78249e72-bfe0-4422-aefc-e20f841bb1e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:24.780127 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-78249e72-bfe0-4422-aefc-e20f841bb1e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:24.780127 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-78249e72-bfe0-4422-aefc-e20f841bb1e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:24.801272 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-c5b824d1-3dc1-42d8-acd0-caa374e95dd9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Getting quotas for project 606c24bee18a4454ab672cfb6a395286. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:35:24.810623 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-c5b824d1-3dc1-42d8-acd0-caa374e95dd9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Getting quotas for user 2a927401086b4a649919a6071b4a0fd9 and project 606c24bee18a4454ab672cfb6a395286. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:35:24.835091 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c5b824d1-3dc1-42d8-acd0-caa374e95dd9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Going to run 1 instances... {{(pid=128048) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:35:24.839813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c5b824d1-3dc1-42d8-acd0-caa374e95dd9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12947ed8-8ca9-442d-9224-509e79a198e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128048) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:35:24.910692 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-78249e72-bfe0-4422-aefc-e20f841bb1e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:24.934056 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-78249e72-bfe0-4422-aefc-e20f841bb1e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1246 microversion: 2.1 time: 0.175258 Aug 31 00:35:24.934967 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 31/50] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:24 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1246 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:25.046295 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-c5b824d1-3dc1-42d8-acd0-caa374e95dd9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 6.440029 Aug 31 00:35:25.047027 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 20/51] 10.222.0.65 () {62 vars in 1188 bytes} [Wed Aug 31 00:35:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 6444 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 00:35:25.060252 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6481ca74-f54c-43bc-b20b-b741152ecb0f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:25.060907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6481ca74-f54c-43bc-b20b-b741152ecb0f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:25.135245 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6481ca74-f54c-43bc-b20b-b741152ecb0f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:25.143508 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6481ca74-f54c-43bc-b20b-b741152ecb0f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:25.144975 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6481ca74-f54c-43bc-b20b-b741152ecb0f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:25.146247 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6481ca74-f54c-43bc-b20b-b741152ecb0f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1281 microversion: 2.20 time: 0.090600 Aug 31 00:35:25.146788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 32/52] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:25 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1281 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:35:25.484949 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-1bbf174c-04da-4f88-bb7a-4e12199e6579 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:25.486847 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-1bbf174c-04da-4f88-bb7a-4e12199e6579 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:25.487814 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-5bb6c947-345b-48d1-910a-4d63eaf49b4b req-963e0fd7-98b0-442c-8b38-9b9b215eb584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6fcd7c-4829-401e-88dc-0520b01562ff", "tag": "79a597d8-aec3-4139-9872-88eb69cbc272"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:35:25.504772 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1bbf174c-04da-4f88-bb7a-4e12199e6579 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:25.509158 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-5bb6c947-345b-48d1-910a-4d63eaf49b4b req-963e0fd7-98b0-442c-8b38-9b9b215eb584 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:25.509416 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1bbf174c-04da-4f88-bb7a-4e12199e6579 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:25.509502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-5bb6c947-345b-48d1-910a-4d63eaf49b4b req-963e0fd7-98b0-442c-8b38-9b9b215eb584 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:25.509502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-5bb6c947-345b-48d1-910a-4d63eaf49b4b req-963e0fd7-98b0-442c-8b38-9b9b215eb584 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:25.509644 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1bbf174c-04da-4f88-bb7a-4e12199e6579 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:25.509644 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1bbf174c-04da-4f88-bb7a-4e12199e6579 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:25.509644 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1bbf174c-04da-4f88-bb7a-4e12199e6579 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:25.509938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1bbf174c-04da-4f88-bb7a-4e12199e6579 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:25.517571 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-5bb6c947-345b-48d1-910a-4d63eaf49b4b req-963e0fd7-98b0-442c-8b38-9b9b215eb584 service nova] Creating event network-changed:79a597d8-aec3-4139-9872-88eb69cbc272 for instance ca6fcd7c-4829-401e-88dc-0520b01562ff on hv-cinder-85221 Aug 31 00:35:25.522703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-5bb6c947-345b-48d1-910a-4d63eaf49b4b req-963e0fd7-98b0-442c-8b38-9b9b215eb584 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038627 Aug 31 00:35:25.524969 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 33/53] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:35:25.704591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-1bbf174c-04da-4f88-bb7a-4e12199e6579 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:25.714815 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-1bbf174c-04da-4f88-bb7a-4e12199e6579 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.240620 Aug 31 00:35:25.715976 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 21/54] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:25 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:25.782140 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-186ba4c2-bb1d-4d35-9940-7c5e9de2bbb7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:25.782913 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-186ba4c2-bb1d-4d35-9940-7c5e9de2bbb7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:25.789999 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-186ba4c2-bb1d-4d35-9940-7c5e9de2bbb7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:25.790555 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-186ba4c2-bb1d-4d35-9940-7c5e9de2bbb7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:25.791145 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-186ba4c2-bb1d-4d35-9940-7c5e9de2bbb7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:25.791970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-186ba4c2-bb1d-4d35-9940-7c5e9de2bbb7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:25.792448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-186ba4c2-bb1d-4d35-9940-7c5e9de2bbb7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:25.792866 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-186ba4c2-bb1d-4d35-9940-7c5e9de2bbb7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:25.944044 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-186ba4c2-bb1d-4d35-9940-7c5e9de2bbb7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:25.949609 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=100 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:35:25.957567 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-186ba4c2-bb1d-4d35-9940-7c5e9de2bbb7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.179794 Aug 31 00:35:25.958447 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 34/55] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:25 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:25.960044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-63c8d304-8c54-410e-b9ec-3d8f1bc79d3d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:25.961409 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-63c8d304-8c54-410e-b9ec-3d8f1bc79d3d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:25.968860 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-63c8d304-8c54-410e-b9ec-3d8f1bc79d3d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:25.969589 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-63c8d304-8c54-410e-b9ec-3d8f1bc79d3d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:25.970176 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-63c8d304-8c54-410e-b9ec-3d8f1bc79d3d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:25.971021 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-63c8d304-8c54-410e-b9ec-3d8f1bc79d3d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:25.971624 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-63c8d304-8c54-410e-b9ec-3d8f1bc79d3d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:25.972197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-63c8d304-8c54-410e-b9ec-3d8f1bc79d3d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:26.036872 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-63c8d304-8c54-410e-b9ec-3d8f1bc79d3d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:26.044405 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-63c8d304-8c54-410e-b9ec-3d8f1bc79d3d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1246 microversion: 2.1 time: 0.088522 Aug 31 00:35:26.044955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 22/56] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:25 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:26.183663 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-110f338e-b958-4ab3-bfd1-c1f07bee883f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:26.183663 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-110f338e-b958-4ab3-bfd1-c1f07bee883f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:26.245858 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-110f338e-b958-4ab3-bfd1-c1f07bee883f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:26.254119 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-110f338e-b958-4ab3-bfd1-c1f07bee883f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:26.255946 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-110f338e-b958-4ab3-bfd1-c1f07bee883f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:26.257377 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-110f338e-b958-4ab3-bfd1-c1f07bee883f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1281 microversion: 2.20 time: 0.091184 Aug 31 00:35:26.258215 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 35/57] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:26 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1281 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:35:26.737993 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-015a0586-f30c-4ada-b934-5c674c58adfc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:26.739231 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-015a0586-f30c-4ada-b934-5c674c58adfc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:26.746840 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-015a0586-f30c-4ada-b934-5c674c58adfc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:26.747477 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-015a0586-f30c-4ada-b934-5c674c58adfc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:26.747915 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-015a0586-f30c-4ada-b934-5c674c58adfc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:26.748662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-015a0586-f30c-4ada-b934-5c674c58adfc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:26.749171 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-015a0586-f30c-4ada-b934-5c674c58adfc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:26.749525 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-015a0586-f30c-4ada-b934-5c674c58adfc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:26.911079 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-015a0586-f30c-4ada-b934-5c674c58adfc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:26.920573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-015a0586-f30c-4ada-b934-5c674c58adfc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.187751 Aug 31 00:35:26.921270 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 23/58] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:26 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:26.986533 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-15d42612-af76-4aeb-b4a8-f11a4f703b67 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:26.989315 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-15d42612-af76-4aeb-b4a8-f11a4f703b67 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:26.993621 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-15d42612-af76-4aeb-b4a8-f11a4f703b67 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:26.994131 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-15d42612-af76-4aeb-b4a8-f11a4f703b67 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:26.994848 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-15d42612-af76-4aeb-b4a8-f11a4f703b67 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:26.995247 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-15d42612-af76-4aeb-b4a8-f11a4f703b67 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:26.995703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-15d42612-af76-4aeb-b4a8-f11a4f703b67 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:26.996119 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-15d42612-af76-4aeb-b4a8-f11a4f703b67 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:27.066305 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7139da1a-bb51-4045-be08-37f151322a60 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:27.067400 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7139da1a-bb51-4045-be08-37f151322a60 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:27.074825 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7139da1a-bb51-4045-be08-37f151322a60 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:27.075816 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7139da1a-bb51-4045-be08-37f151322a60 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:27.076537 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7139da1a-bb51-4045-be08-37f151322a60 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:27.077750 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7139da1a-bb51-4045-be08-37f151322a60 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:27.081054 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7139da1a-bb51-4045-be08-37f151322a60 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:27.081054 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7139da1a-bb51-4045-be08-37f151322a60 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:27.151219 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-15d42612-af76-4aeb-b4a8-f11a4f703b67 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:27.160495 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-15d42612-af76-4aeb-b4a8-f11a4f703b67 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.185164 Aug 31 00:35:27.161839 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 36/59] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:26 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:27.166419 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-7139da1a-bb51-4045-be08-37f151322a60 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:27.175741 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-7139da1a-bb51-4045-be08-37f151322a60 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1246 microversion: 2.1 time: 0.113525 Aug 31 00:35:27.176309 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 24/60] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:27 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1246 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:27.287784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-1ff64d7d-6e8d-478b-8640-47a597ed727c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:27.289737 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-1ff64d7d-6e8d-478b-8640-47a597ed727c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:27.298963 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1ff64d7d-6e8d-478b-8640-47a597ed727c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:27.299649 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1ff64d7d-6e8d-478b-8640-47a597ed727c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:27.300692 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1ff64d7d-6e8d-478b-8640-47a597ed727c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:27.301807 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1ff64d7d-6e8d-478b-8640-47a597ed727c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:27.302769 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1ff64d7d-6e8d-478b-8640-47a597ed727c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:27.303403 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1ff64d7d-6e8d-478b-8640-47a597ed727c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:27.419021 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-1ff64d7d-6e8d-478b-8640-47a597ed727c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:27.431100 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-1ff64d7d-6e8d-478b-8640-47a597ed727c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:27.432649 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-1ff64d7d-6e8d-478b-8640-47a597ed727c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:27.433943 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-1ff64d7d-6e8d-478b-8640-47a597ed727c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1285 microversion: 2.20 time: 0.156591 Aug 31 00:35:27.435088 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 37/61] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:27 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:35:27.944261 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-79c85b64-f7c0-47a8-9df1-eb06fa8765b1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:27.945277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-79c85b64-f7c0-47a8-9df1-eb06fa8765b1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:27.951234 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-79c85b64-f7c0-47a8-9df1-eb06fa8765b1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:27.951714 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-79c85b64-f7c0-47a8-9df1-eb06fa8765b1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:27.952145 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-79c85b64-f7c0-47a8-9df1-eb06fa8765b1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:27.952869 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-79c85b64-f7c0-47a8-9df1-eb06fa8765b1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:27.954477 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-79c85b64-f7c0-47a8-9df1-eb06fa8765b1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:27.955058 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-79c85b64-f7c0-47a8-9df1-eb06fa8765b1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:28.105445 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-79c85b64-f7c0-47a8-9df1-eb06fa8765b1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:28.115219 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-79c85b64-f7c0-47a8-9df1-eb06fa8765b1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.175626 Aug 31 00:35:28.116516 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 25/62] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:27 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:28.182907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-9e2278a9-0d12-4416-ba7a-0c803748f2cf tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:28.184049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-9e2278a9-0d12-4416-ba7a-0c803748f2cf tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:28.190396 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9e2278a9-0d12-4416-ba7a-0c803748f2cf tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:28.190873 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9e2278a9-0d12-4416-ba7a-0c803748f2cf tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:28.191466 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9e2278a9-0d12-4416-ba7a-0c803748f2cf tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:28.192412 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9e2278a9-0d12-4416-ba7a-0c803748f2cf tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:28.193017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9e2278a9-0d12-4416-ba7a-0c803748f2cf tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:28.193442 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9e2278a9-0d12-4416-ba7a-0c803748f2cf tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:28.198767 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-42d61ee5-a935-47a4-a818-94656963c100 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:28.199378 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-42d61ee5-a935-47a4-a818-94656963c100 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:28.206814 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-42d61ee5-a935-47a4-a818-94656963c100 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:28.207986 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-42d61ee5-a935-47a4-a818-94656963c100 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:28.208449 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-42d61ee5-a935-47a4-a818-94656963c100 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:28.209606 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-42d61ee5-a935-47a4-a818-94656963c100 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:28.210334 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-42d61ee5-a935-47a4-a818-94656963c100 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:28.211388 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-42d61ee5-a935-47a4-a818-94656963c100 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:28.288987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-42d61ee5-a935-47a4-a818-94656963c100 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:28.298123 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-42d61ee5-a935-47a4-a818-94656963c100 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1246 microversion: 2.1 time: 0.104332 Aug 31 00:35:28.298700 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 26/63] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:28 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1246 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:28.374670 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-9e2278a9-0d12-4416-ba7a-0c803748f2cf tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:28.385629 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-9e2278a9-0d12-4416-ba7a-0c803748f2cf tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.206848 Aug 31 00:35:28.386458 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 38/64] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:28 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:28.471631 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f41c4fca-6e49-463c-be4f-36f7af6eff0b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:28.472228 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-f41c4fca-6e49-463c-be4f-36f7af6eff0b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:28.480819 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f41c4fca-6e49-463c-be4f-36f7af6eff0b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:28.480819 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f41c4fca-6e49-463c-be4f-36f7af6eff0b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:28.480819 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f41c4fca-6e49-463c-be4f-36f7af6eff0b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:28.480819 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f41c4fca-6e49-463c-be4f-36f7af6eff0b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:28.481422 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f41c4fca-6e49-463c-be4f-36f7af6eff0b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:28.481422 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f41c4fca-6e49-463c-be4f-36f7af6eff0b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:28.558520 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f41c4fca-6e49-463c-be4f-36f7af6eff0b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:28.566710 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f41c4fca-6e49-463c-be4f-36f7af6eff0b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:28.568287 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f41c4fca-6e49-463c-be4f-36f7af6eff0b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:28.569335 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f41c4fca-6e49-463c-be4f-36f7af6eff0b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1285 microversion: 2.20 time: 0.101762 Aug 31 00:35:28.570694 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 27/65] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:28 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:35:29.139532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-aa270f58-6489-4f22-8d7a-b5450360168d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:29.140178 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-aa270f58-6489-4f22-8d7a-b5450360168d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:29.146513 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aa270f58-6489-4f22-8d7a-b5450360168d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:29.146998 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aa270f58-6489-4f22-8d7a-b5450360168d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:29.147431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aa270f58-6489-4f22-8d7a-b5450360168d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:29.148316 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aa270f58-6489-4f22-8d7a-b5450360168d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:29.148797 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aa270f58-6489-4f22-8d7a-b5450360168d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:29.149214 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aa270f58-6489-4f22-8d7a-b5450360168d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:29.296918 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-aa270f58-6489-4f22-8d7a-b5450360168d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:29.304656 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-aa270f58-6489-4f22-8d7a-b5450360168d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.169641 Aug 31 00:35:29.305224 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 39/66] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:29 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:29.319816 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-168aef7e-1b93-4835-b608-2c75226d1baf tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:29.321337 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-168aef7e-1b93-4835-b608-2c75226d1baf tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:29.346418 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-168aef7e-1b93-4835-b608-2c75226d1baf tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:29.346418 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-168aef7e-1b93-4835-b608-2c75226d1baf tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:29.346418 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-168aef7e-1b93-4835-b608-2c75226d1baf tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:29.346418 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-168aef7e-1b93-4835-b608-2c75226d1baf tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:29.346804 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-168aef7e-1b93-4835-b608-2c75226d1baf tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:29.346804 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-168aef7e-1b93-4835-b608-2c75226d1baf tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:29.391619 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-168aef7e-1b93-4835-b608-2c75226d1baf tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:29.405715 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-168aef7e-1b93-4835-b608-2c75226d1baf tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1246 microversion: 2.1 time: 0.089522 Aug 31 00:35:29.420887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 28/67] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:29 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:29.421438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4266c80c-2b49-448d-8707-2eac0d78a15f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:29.421438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4266c80c-2b49-448d-8707-2eac0d78a15f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:29.424182 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4266c80c-2b49-448d-8707-2eac0d78a15f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:29.424710 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4266c80c-2b49-448d-8707-2eac0d78a15f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:29.425269 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4266c80c-2b49-448d-8707-2eac0d78a15f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:29.426162 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4266c80c-2b49-448d-8707-2eac0d78a15f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:29.426392 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4266c80c-2b49-448d-8707-2eac0d78a15f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:29.426936 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4266c80c-2b49-448d-8707-2eac0d78a15f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:29.593889 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-52cac7eb-c68b-42fe-b132-34d23b23ddc5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:29.594501 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-52cac7eb-c68b-42fe-b132-34d23b23ddc5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:29.603596 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4266c80c-2b49-448d-8707-2eac0d78a15f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:29.603712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-52cac7eb-c68b-42fe-b132-34d23b23ddc5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:29.603712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-52cac7eb-c68b-42fe-b132-34d23b23ddc5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:29.603712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-52cac7eb-c68b-42fe-b132-34d23b23ddc5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:29.603712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-52cac7eb-c68b-42fe-b132-34d23b23ddc5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:29.604054 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-52cac7eb-c68b-42fe-b132-34d23b23ddc5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:29.604054 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-52cac7eb-c68b-42fe-b132-34d23b23ddc5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:29.608148 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=100 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:35:29.612005 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4266c80c-2b49-448d-8707-2eac0d78a15f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.206110 Aug 31 00:35:29.612743 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 40/68] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:29 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:29.689015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-52cac7eb-c68b-42fe-b132-34d23b23ddc5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:29.689015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-52cac7eb-c68b-42fe-b132-34d23b23ddc5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:29.689424 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-52cac7eb-c68b-42fe-b132-34d23b23ddc5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:29.689424 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-52cac7eb-c68b-42fe-b132-34d23b23ddc5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1285 microversion: 2.20 time: 0.096546 Aug 31 00:35:29.689424 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 29/69] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:29 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:35:30.326920 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-beccdda9-e7a0-4457-bead-b63228a2d420 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:30.327536 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-beccdda9-e7a0-4457-bead-b63228a2d420 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:30.338949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-beccdda9-e7a0-4457-bead-b63228a2d420 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:30.340609 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-beccdda9-e7a0-4457-bead-b63228a2d420 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:30.340609 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-beccdda9-e7a0-4457-bead-b63228a2d420 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:30.341047 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-beccdda9-e7a0-4457-bead-b63228a2d420 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:30.341199 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-beccdda9-e7a0-4457-bead-b63228a2d420 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:30.341654 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-beccdda9-e7a0-4457-bead-b63228a2d420 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:30.432734 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-6121684b-c9b4-457e-bdf5-3faff31d4534 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:30.434594 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-6121684b-c9b4-457e-bdf5-3faff31d4534 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:30.443550 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:35:30.447359 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6121684b-c9b4-457e-bdf5-3faff31d4534 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:30.448217 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6121684b-c9b4-457e-bdf5-3faff31d4534 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:30.448907 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6121684b-c9b4-457e-bdf5-3faff31d4534 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:30.450194 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6121684b-c9b4-457e-bdf5-3faff31d4534 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:30.451553 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6121684b-c9b4-457e-bdf5-3faff31d4534 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:30.452187 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6121684b-c9b4-457e-bdf5-3faff31d4534 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:30.521241 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-beccdda9-e7a0-4457-bead-b63228a2d420 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:30.521241 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-beccdda9-e7a0-4457-bead-b63228a2d420 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.197160 Aug 31 00:35:30.521241 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 41/70] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:30 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:30.543974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-6121684b-c9b4-457e-bdf5-3faff31d4534 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:30.552026 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-6121684b-c9b4-457e-bdf5-3faff31d4534 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1246 microversion: 2.1 time: 0.128224 Aug 31 00:35:30.552619 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 30/71] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:30 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1246 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:30.634590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-daf64b25-78fb-4f81-a98b-3482630d64e0 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:30.637952 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-daf64b25-78fb-4f81-a98b-3482630d64e0 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:30.650341 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-daf64b25-78fb-4f81-a98b-3482630d64e0 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:30.652597 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-daf64b25-78fb-4f81-a98b-3482630d64e0 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:30.654894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-daf64b25-78fb-4f81-a98b-3482630d64e0 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:30.656825 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-daf64b25-78fb-4f81-a98b-3482630d64e0 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:30.657552 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-daf64b25-78fb-4f81-a98b-3482630d64e0 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:30.662909 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-daf64b25-78fb-4f81-a98b-3482630d64e0 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:30.710971 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-96d75a39-6e45-4819-9f64-31bba80a7d84 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:30.711672 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-96d75a39-6e45-4819-9f64-31bba80a7d84 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:30.718623 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-96d75a39-6e45-4819-9f64-31bba80a7d84 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:30.719324 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-96d75a39-6e45-4819-9f64-31bba80a7d84 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:30.719881 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-96d75a39-6e45-4819-9f64-31bba80a7d84 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:30.720936 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-96d75a39-6e45-4819-9f64-31bba80a7d84 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:30.721546 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-96d75a39-6e45-4819-9f64-31bba80a7d84 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:30.721977 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-96d75a39-6e45-4819-9f64-31bba80a7d84 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:30.852538 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-daf64b25-78fb-4f81-a98b-3482630d64e0 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:30.857046 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-daf64b25-78fb-4f81-a98b-3482630d64e0 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.226580 Aug 31 00:35:30.867507 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 42/72] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:30 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:30.892667 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-96d75a39-6e45-4819-9f64-31bba80a7d84 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:30.904905 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-96d75a39-6e45-4819-9f64-31bba80a7d84 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:30.904905 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-96d75a39-6e45-4819-9f64-31bba80a7d84 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:30.905358 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-96d75a39-6e45-4819-9f64-31bba80a7d84 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1285 microversion: 2.20 time: 0.199400 Aug 31 00:35:30.905910 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 31/73] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:30 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1285 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:35:31.541880 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-36ec95db-6096-4bc7-a7ff-e3a1a43d6fcd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:31.543369 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-36ec95db-6096-4bc7-a7ff-e3a1a43d6fcd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:31.560252 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-36ec95db-6096-4bc7-a7ff-e3a1a43d6fcd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:31.560252 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-36ec95db-6096-4bc7-a7ff-e3a1a43d6fcd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:31.560252 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-36ec95db-6096-4bc7-a7ff-e3a1a43d6fcd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:31.560252 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-36ec95db-6096-4bc7-a7ff-e3a1a43d6fcd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:31.561260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-36ec95db-6096-4bc7-a7ff-e3a1a43d6fcd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:31.561260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-36ec95db-6096-4bc7-a7ff-e3a1a43d6fcd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:31.574745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-735aad6c-cd95-4d82-afd3-638ab1d6ab0e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:31.575376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-735aad6c-cd95-4d82-afd3-638ab1d6ab0e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:31.589114 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-735aad6c-cd95-4d82-afd3-638ab1d6ab0e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:31.589642 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-735aad6c-cd95-4d82-afd3-638ab1d6ab0e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:31.590173 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-735aad6c-cd95-4d82-afd3-638ab1d6ab0e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:31.590894 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-735aad6c-cd95-4d82-afd3-638ab1d6ab0e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:31.591349 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-735aad6c-cd95-4d82-afd3-638ab1d6ab0e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:31.592059 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-735aad6c-cd95-4d82-afd3-638ab1d6ab0e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:31.678029 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-735aad6c-cd95-4d82-afd3-638ab1d6ab0e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:31.690276 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-735aad6c-cd95-4d82-afd3-638ab1d6ab0e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1238 microversion: 2.1 time: 0.120171 Aug 31 00:35:31.691023 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 32/74] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:31 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1238 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:31.788945 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-36ec95db-6096-4bc7-a7ff-e3a1a43d6fcd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:31.797873 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-36ec95db-6096-4bc7-a7ff-e3a1a43d6fcd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.260088 Aug 31 00:35:31.816497 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 43/75] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:31 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:31.880406 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-665a596c-660e-4511-bb73-551161331548 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:31.881074 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-665a596c-660e-4511-bb73-551161331548 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:31.887918 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-665a596c-660e-4511-bb73-551161331548 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:31.888499 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-665a596c-660e-4511-bb73-551161331548 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:31.889129 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-665a596c-660e-4511-bb73-551161331548 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:31.889834 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-665a596c-660e-4511-bb73-551161331548 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:31.890296 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-665a596c-660e-4511-bb73-551161331548 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:31.890714 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-665a596c-660e-4511-bb73-551161331548 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:31.929518 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-9a1774f3-a8e9-4775-b225-e04f048df1dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:31.930448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-9a1774f3-a8e9-4775-b225-e04f048df1dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:31.940765 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9a1774f3-a8e9-4775-b225-e04f048df1dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:31.941432 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9a1774f3-a8e9-4775-b225-e04f048df1dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:31.942141 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9a1774f3-a8e9-4775-b225-e04f048df1dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:31.943067 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9a1774f3-a8e9-4775-b225-e04f048df1dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:31.943797 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9a1774f3-a8e9-4775-b225-e04f048df1dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:31.944506 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9a1774f3-a8e9-4775-b225-e04f048df1dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:32.027889 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-9a1774f3-a8e9-4775-b225-e04f048df1dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:32.039522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-9a1774f3-a8e9-4775-b225-e04f048df1dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:32.041083 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-9a1774f3-a8e9-4775-b225-e04f048df1dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:32.042302 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-9a1774f3-a8e9-4775-b225-e04f048df1dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1285 microversion: 2.20 time: 0.117297 Aug 31 00:35:32.044941 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 44/76] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:31 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:35:32.078037 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-665a596c-660e-4511-bb73-551161331548 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:32.086004 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-665a596c-660e-4511-bb73-551161331548 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.209978 Aug 31 00:35:32.088603 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 33/77] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:31 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:32.714934 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6da0dbec-1b35-4afe-9156-dfd31ae7e1e8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:32.715581 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6da0dbec-1b35-4afe-9156-dfd31ae7e1e8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:32.717558 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=4 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:35:32.722669 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6da0dbec-1b35-4afe-9156-dfd31ae7e1e8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:32.723153 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6da0dbec-1b35-4afe-9156-dfd31ae7e1e8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:32.723794 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6da0dbec-1b35-4afe-9156-dfd31ae7e1e8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:32.724532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6da0dbec-1b35-4afe-9156-dfd31ae7e1e8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:32.724977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6da0dbec-1b35-4afe-9156-dfd31ae7e1e8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:32.726350 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6da0dbec-1b35-4afe-9156-dfd31ae7e1e8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:32.795294 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6da0dbec-1b35-4afe-9156-dfd31ae7e1e8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:32.803375 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6da0dbec-1b35-4afe-9156-dfd31ae7e1e8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1238 microversion: 2.1 time: 0.092808 Aug 31 00:35:32.803956 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 45/78] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:32 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1238 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:32.826666 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-84c6f2a2-3850-4184-8359-b2ba71e4affb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:32.827910 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-84c6f2a2-3850-4184-8359-b2ba71e4affb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:32.836165 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-84c6f2a2-3850-4184-8359-b2ba71e4affb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:32.836474 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-84c6f2a2-3850-4184-8359-b2ba71e4affb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:32.837116 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-84c6f2a2-3850-4184-8359-b2ba71e4affb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:32.837828 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-84c6f2a2-3850-4184-8359-b2ba71e4affb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:32.838288 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-84c6f2a2-3850-4184-8359-b2ba71e4affb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:32.838717 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-84c6f2a2-3850-4184-8359-b2ba71e4affb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:32.989824 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-84c6f2a2-3850-4184-8359-b2ba71e4affb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:32.997805 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-84c6f2a2-3850-4184-8359-b2ba71e4affb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.174960 Aug 31 00:35:32.998343 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 34/79] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:32 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:33.067385 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0e859cca-2d6d-4470-a658-d7ce1bc66e2c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:33.074554 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-0e859cca-2d6d-4470-a658-d7ce1bc66e2c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:33.074554 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0e859cca-2d6d-4470-a658-d7ce1bc66e2c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:33.075130 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0e859cca-2d6d-4470-a658-d7ce1bc66e2c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:33.075343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0e859cca-2d6d-4470-a658-d7ce1bc66e2c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:33.076212 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0e859cca-2d6d-4470-a658-d7ce1bc66e2c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:33.076681 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0e859cca-2d6d-4470-a658-d7ce1bc66e2c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:33.077094 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0e859cca-2d6d-4470-a658-d7ce1bc66e2c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:33.108111 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d68c4503-11f2-484b-9683-1609c9c8de7b tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:33.108794 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d68c4503-11f2-484b-9683-1609c9c8de7b tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:33.114775 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d68c4503-11f2-484b-9683-1609c9c8de7b tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:33.115441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d68c4503-11f2-484b-9683-1609c9c8de7b tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:33.115870 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d68c4503-11f2-484b-9683-1609c9c8de7b tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:33.116643 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d68c4503-11f2-484b-9683-1609c9c8de7b tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:33.117087 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d68c4503-11f2-484b-9683-1609c9c8de7b tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:33.117543 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d68c4503-11f2-484b-9683-1609c9c8de7b tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:33.159430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-0e859cca-2d6d-4470-a658-d7ce1bc66e2c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:33.168561 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-0e859cca-2d6d-4470-a658-d7ce1bc66e2c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:33.169996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-0e859cca-2d6d-4470-a658-d7ce1bc66e2c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:33.171086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-0e859cca-2d6d-4470-a658-d7ce1bc66e2c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1277 microversion: 2.20 time: 0.107933 Aug 31 00:35:33.171634 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 46/80] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:33 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:35:33.510045 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d68c4503-11f2-484b-9683-1609c9c8de7b tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:33.518771 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d68c4503-11f2-484b-9683-1609c9c8de7b tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.414888 Aug 31 00:35:33.519342 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 35/81] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:33 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:33.826635 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3e4b3dcf-4558-422f-9b93-b2a007edb8d0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:33.827852 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-3e4b3dcf-4558-422f-9b93-b2a007edb8d0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:33.837811 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3e4b3dcf-4558-422f-9b93-b2a007edb8d0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:33.839027 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3e4b3dcf-4558-422f-9b93-b2a007edb8d0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:33.840537 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3e4b3dcf-4558-422f-9b93-b2a007edb8d0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:33.841658 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3e4b3dcf-4558-422f-9b93-b2a007edb8d0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:33.842376 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3e4b3dcf-4558-422f-9b93-b2a007edb8d0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:33.842947 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3e4b3dcf-4558-422f-9b93-b2a007edb8d0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:33.932155 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-3e4b3dcf-4558-422f-9b93-b2a007edb8d0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:33.940234 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-3e4b3dcf-4558-422f-9b93-b2a007edb8d0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1294 microversion: 2.1 time: 0.117335 Aug 31 00:35:33.940882 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 47/82] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:33 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1294 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:34.018797 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-40281cbe-3ef7-4439-9c95-471ec748a137 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:34.019407 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-40281cbe-3ef7-4439-9c95-471ec748a137 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:34.026330 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-40281cbe-3ef7-4439-9c95-471ec748a137 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:34.026809 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-40281cbe-3ef7-4439-9c95-471ec748a137 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:34.027235 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-40281cbe-3ef7-4439-9c95-471ec748a137 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:34.027923 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-40281cbe-3ef7-4439-9c95-471ec748a137 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:34.028385 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-40281cbe-3ef7-4439-9c95-471ec748a137 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:34.028799 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-40281cbe-3ef7-4439-9c95-471ec748a137 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:34.199429 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4582c760-2384-44f3-aac0-32965c9963e3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:34.200720 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4582c760-2384-44f3-aac0-32965c9963e3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:34.207487 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4582c760-2384-44f3-aac0-32965c9963e3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:34.208829 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4582c760-2384-44f3-aac0-32965c9963e3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:34.212112 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4582c760-2384-44f3-aac0-32965c9963e3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:34.218181 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4582c760-2384-44f3-aac0-32965c9963e3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:34.218723 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4582c760-2384-44f3-aac0-32965c9963e3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:34.219203 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4582c760-2384-44f3-aac0-32965c9963e3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:34.329246 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4582c760-2384-44f3-aac0-32965c9963e3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:34.344109 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4582c760-2384-44f3-aac0-32965c9963e3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:34.348033 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4582c760-2384-44f3-aac0-32965c9963e3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:34.351322 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4582c760-2384-44f3-aac0-32965c9963e3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1333 microversion: 2.20 time: 0.155861 Aug 31 00:35:34.352084 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 48/83] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:34 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1333 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:35:34.434110 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-40281cbe-3ef7-4439-9c95-471ec748a137 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:34.442386 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-40281cbe-3ef7-4439-9c95-471ec748a137 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.427536 Aug 31 00:35:34.443112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 36/84] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:34 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:34.543129 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-12352529-5753-4045-b670-e54c203eec4f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:34.543768 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-12352529-5753-4045-b670-e54c203eec4f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:34.550629 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12352529-5753-4045-b670-e54c203eec4f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:34.551118 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12352529-5753-4045-b670-e54c203eec4f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:34.551559 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12352529-5753-4045-b670-e54c203eec4f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:34.552265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12352529-5753-4045-b670-e54c203eec4f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:34.552712 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12352529-5753-4045-b670-e54c203eec4f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:34.553127 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12352529-5753-4045-b670-e54c203eec4f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:34.692151 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-12352529-5753-4045-b670-e54c203eec4f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:34.700193 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-12352529-5753-4045-b670-e54c203eec4f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.160907 Aug 31 00:35:34.700791 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 49/85] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:34 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:34.965393 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-b981a7c7-2d25-445a-8514-aff3de08f854 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:34.967432 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-b981a7c7-2d25-445a-8514-aff3de08f854 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:34.974955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:35:34.976143 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=6 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:35:34.978059 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b981a7c7-2d25-445a-8514-aff3de08f854 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:34.979549 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b981a7c7-2d25-445a-8514-aff3de08f854 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:34.980308 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b981a7c7-2d25-445a-8514-aff3de08f854 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:34.981408 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b981a7c7-2d25-445a-8514-aff3de08f854 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:34.982441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b981a7c7-2d25-445a-8514-aff3de08f854 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:34.983513 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b981a7c7-2d25-445a-8514-aff3de08f854 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:35.075111 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b981a7c7-2d25-445a-8514-aff3de08f854 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:35.091535 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-b981a7c7-2d25-445a-8514-aff3de08f854 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1294 microversion: 2.1 time: 0.131905 Aug 31 00:35:35.093004 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 37/86] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:34 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1294 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:35.389502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-52eb5e7c-1fa2-430c-bd21-b9cecc503d80 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:35.389502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-52eb5e7c-1fa2-430c-bd21-b9cecc503d80 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:35.398970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-52eb5e7c-1fa2-430c-bd21-b9cecc503d80 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:35.401457 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-52eb5e7c-1fa2-430c-bd21-b9cecc503d80 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:35.402530 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-52eb5e7c-1fa2-430c-bd21-b9cecc503d80 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:35.404061 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-52eb5e7c-1fa2-430c-bd21-b9cecc503d80 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:35.405756 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-52eb5e7c-1fa2-430c-bd21-b9cecc503d80 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:35.407705 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-52eb5e7c-1fa2-430c-bd21-b9cecc503d80 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:35.471997 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-3d9e63cb-5b8b-4a8c-a2cc-e6679e4513dc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:35.473341 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-3d9e63cb-5b8b-4a8c-a2cc-e6679e4513dc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:35.495577 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3d9e63cb-5b8b-4a8c-a2cc-e6679e4513dc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:35.496228 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3d9e63cb-5b8b-4a8c-a2cc-e6679e4513dc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:35.496840 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3d9e63cb-5b8b-4a8c-a2cc-e6679e4513dc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:35.498410 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3d9e63cb-5b8b-4a8c-a2cc-e6679e4513dc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:35.499119 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3d9e63cb-5b8b-4a8c-a2cc-e6679e4513dc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:35.510543 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3d9e63cb-5b8b-4a8c-a2cc-e6679e4513dc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:35.544023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-52eb5e7c-1fa2-430c-bd21-b9cecc503d80 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:35.554401 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-52eb5e7c-1fa2-430c-bd21-b9cecc503d80 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:35.556379 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-52eb5e7c-1fa2-430c-bd21-b9cecc503d80 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:35.557989 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-52eb5e7c-1fa2-430c-bd21-b9cecc503d80 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1341 microversion: 2.20 time: 0.186536 Aug 31 00:35:35.559198 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 50/87] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:35 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1341 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:35:35.727754 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-1a5154e1-8a68-4ff0-85d5-ebd2f25e1615 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:35.728355 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-1a5154e1-8a68-4ff0-85d5-ebd2f25e1615 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:35.739608 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1a5154e1-8a68-4ff0-85d5-ebd2f25e1615 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:35.740101 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1a5154e1-8a68-4ff0-85d5-ebd2f25e1615 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:35.740568 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1a5154e1-8a68-4ff0-85d5-ebd2f25e1615 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:35.742862 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1a5154e1-8a68-4ff0-85d5-ebd2f25e1615 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:35.743348 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1a5154e1-8a68-4ff0-85d5-ebd2f25e1615 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:35.743761 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1a5154e1-8a68-4ff0-85d5-ebd2f25e1615 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:36.010652 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-1a5154e1-8a68-4ff0-85d5-ebd2f25e1615 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:36.020163 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-1a5154e1-8a68-4ff0-85d5-ebd2f25e1615 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.299846 Aug 31 00:35:36.021539 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 51/88] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:35 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:36.082046 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-3d9e63cb-5b8b-4a8c-a2cc-e6679e4513dc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:36.097414 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-3d9e63cb-5b8b-4a8c-a2cc-e6679e4513dc tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.634523 Aug 31 00:35:36.098522 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 38/89] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:35 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:36.127849 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-7963b3d4-5ff4-41d8-907f-454377b829e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:36.129967 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-7963b3d4-5ff4-41d8-907f-454377b829e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:36.142171 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7963b3d4-5ff4-41d8-907f-454377b829e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:36.143711 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7963b3d4-5ff4-41d8-907f-454377b829e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:36.144288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7963b3d4-5ff4-41d8-907f-454377b829e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:36.145101 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7963b3d4-5ff4-41d8-907f-454377b829e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:36.145862 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7963b3d4-5ff4-41d8-907f-454377b829e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:36.146352 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7963b3d4-5ff4-41d8-907f-454377b829e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:36.215847 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=100 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:35:36.251743 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=12 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:35:36.268646 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7963b3d4-5ff4-41d8-907f-454377b829e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:36.276990 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-7963b3d4-5ff4-41d8-907f-454377b829e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1312 microversion: 2.1 time: 0.166691 Aug 31 00:35:36.277566 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 52/90] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:36 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:36.586548 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-560759d2-aa14-47d7-ab18-ed413cf87791 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:36.587312 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-560759d2-aa14-47d7-ab18-ed413cf87791 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:36.595604 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-560759d2-aa14-47d7-ab18-ed413cf87791 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:36.596257 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-560759d2-aa14-47d7-ab18-ed413cf87791 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:36.596847 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-560759d2-aa14-47d7-ab18-ed413cf87791 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:36.597662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-560759d2-aa14-47d7-ab18-ed413cf87791 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:36.598304 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-560759d2-aa14-47d7-ab18-ed413cf87791 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:36.598929 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-560759d2-aa14-47d7-ab18-ed413cf87791 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:36.673563 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-560759d2-aa14-47d7-ab18-ed413cf87791 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:36.686258 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-560759d2-aa14-47d7-ab18-ed413cf87791 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:36.687897 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-560759d2-aa14-47d7-ab18-ed413cf87791 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:36.689122 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-560759d2-aa14-47d7-ab18-ed413cf87791 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1339 microversion: 2.20 time: 0.110048 Aug 31 00:35:36.689834 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 39/91] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:36 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1339 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:35:37.052533 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-01ae9ea1-44ae-41cc-9b59-a19ad5041790 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:37.055985 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-01ae9ea1-44ae-41cc-9b59-a19ad5041790 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:37.066818 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-01ae9ea1-44ae-41cc-9b59-a19ad5041790 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:37.067365 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-01ae9ea1-44ae-41cc-9b59-a19ad5041790 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:37.067810 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-01ae9ea1-44ae-41cc-9b59-a19ad5041790 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:37.068548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-01ae9ea1-44ae-41cc-9b59-a19ad5041790 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:37.069003 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-01ae9ea1-44ae-41cc-9b59-a19ad5041790 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:37.070188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-01ae9ea1-44ae-41cc-9b59-a19ad5041790 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:37.218746 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-3491af2e-0288-40d2-b922-18ec83d4f96e req-e38b35ba-ae70-4bf5-9073-1cba3453d821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31dd6cf1-78b5-438d-95ce-aa6229958298", "name": "network-vif-plugged", "status": "completed", "tag": "6033d17d-748b-4a2e-b40d-29f917390834"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:35:37.236987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-3491af2e-0288-40d2-b922-18ec83d4f96e req-e38b35ba-ae70-4bf5-9073-1cba3453d821 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:37.237571 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-3491af2e-0288-40d2-b922-18ec83d4f96e req-e38b35ba-ae70-4bf5-9073-1cba3453d821 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:37.239639 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-3491af2e-0288-40d2-b922-18ec83d4f96e req-e38b35ba-ae70-4bf5-9073-1cba3453d821 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:37.275606 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-3491af2e-0288-40d2-b922-18ec83d4f96e req-e38b35ba-ae70-4bf5-9073-1cba3453d821 service nova] Creating event network-vif-plugged:6033d17d-748b-4a2e-b40d-29f917390834 for instance 31dd6cf1-78b5-438d-95ce-aa6229958298 on hv-cinder-85221 Aug 31 00:35:37.276541 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-3491af2e-0288-40d2-b922-18ec83d4f96e req-e38b35ba-ae70-4bf5-9073-1cba3453d821 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128048) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 00:35:37.277136 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-3491af2e-0288-40d2-b922-18ec83d4f96e req-e38b35ba-ae70-4bf5-9073-1cba3453d821 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128048) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 00:35:37.278957 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0907c93b-efed-45cc-a10d-f1e297b8cca0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:37.279644 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0907c93b-efed-45cc-a10d-f1e297b8cca0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:37.280277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0907c93b-efed-45cc-a10d-f1e297b8cca0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:37.281223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0907c93b-efed-45cc-a10d-f1e297b8cca0 None None] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:37.284795 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0907c93b-efed-45cc-a10d-f1e297b8cca0 None None] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:37.284795 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0907c93b-efed-45cc-a10d-f1e297b8cca0 None None] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:37.292839 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.compute.rpcapi [None req-0907c93b-efed-45cc-a10d-f1e297b8cca0 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 00:35:37.294112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0907c93b-efed-45cc-a10d-f1e297b8cca0 None None] Releasing lock "compute-rpcapi-router" {{(pid=128048) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 00:35:37.314114 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-0907c93b-efed-45cc-a10d-f1e297b8cca0 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213690 Aug 31 00:35:37.315290 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 40/92] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:35:37.324017 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-36cc3e98-cdcb-4404-8f59-3246673a83b2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:37.324761 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-36cc3e98-cdcb-4404-8f59-3246673a83b2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:37.334279 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-36cc3e98-cdcb-4404-8f59-3246673a83b2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:37.334866 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-36cc3e98-cdcb-4404-8f59-3246673a83b2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:37.335298 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-36cc3e98-cdcb-4404-8f59-3246673a83b2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:37.336581 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-36cc3e98-cdcb-4404-8f59-3246673a83b2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:37.337470 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-36cc3e98-cdcb-4404-8f59-3246673a83b2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:37.338088 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-36cc3e98-cdcb-4404-8f59-3246673a83b2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:37.462740 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-01ae9ea1-44ae-41cc-9b59-a19ad5041790 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:37.478326 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-01ae9ea1-44ae-41cc-9b59-a19ad5041790 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.431179 Aug 31 00:35:37.478912 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 53/93] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:37 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:37.494183 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-683c0a18-5de1-4be1-882f-1265d8f2d8ee tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:37.495072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-683c0a18-5de1-4be1-882f-1265d8f2d8ee tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:37.502033 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-683c0a18-5de1-4be1-882f-1265d8f2d8ee tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:37.502612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-683c0a18-5de1-4be1-882f-1265d8f2d8ee tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:37.503257 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-683c0a18-5de1-4be1-882f-1265d8f2d8ee tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:37.504574 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-683c0a18-5de1-4be1-882f-1265d8f2d8ee tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:37.505089 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-683c0a18-5de1-4be1-882f-1265d8f2d8ee tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:37.505633 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-683c0a18-5de1-4be1-882f-1265d8f2d8ee tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:37.573282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-683c0a18-5de1-4be1-882f-1265d8f2d8ee tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:37.581943 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-683c0a18-5de1-4be1-882f-1265d8f2d8ee tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1300 microversion: 2.1 time: 0.100462 Aug 31 00:35:37.582523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 54/94] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:37 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1300 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:37.715172 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-261ab794-c50b-4d3f-9d4c-cc3fbb026bb8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:37.716193 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-261ab794-c50b-4d3f-9d4c-cc3fbb026bb8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:37.724229 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-261ab794-c50b-4d3f-9d4c-cc3fbb026bb8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:37.725875 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-261ab794-c50b-4d3f-9d4c-cc3fbb026bb8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:37.726859 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-261ab794-c50b-4d3f-9d4c-cc3fbb026bb8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:37.728255 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-261ab794-c50b-4d3f-9d4c-cc3fbb026bb8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:37.728946 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-261ab794-c50b-4d3f-9d4c-cc3fbb026bb8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:37.729577 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-261ab794-c50b-4d3f-9d4c-cc3fbb026bb8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:37.853808 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-36cc3e98-cdcb-4404-8f59-3246673a83b2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:37.904854 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-36cc3e98-cdcb-4404-8f59-3246673a83b2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.584592 Aug 31 00:35:37.905916 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 41/95] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:37 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:37.945189 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-261ab794-c50b-4d3f-9d4c-cc3fbb026bb8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:37.958840 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-261ab794-c50b-4d3f-9d4c-cc3fbb026bb8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:37.961542 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-261ab794-c50b-4d3f-9d4c-cc3fbb026bb8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:37.963184 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-261ab794-c50b-4d3f-9d4c-cc3fbb026bb8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1406 microversion: 2.20 time: 0.254181 Aug 31 00:35:37.964960 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 55/96] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:37 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:35:38.499592 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-96a98bfb-d0fc-4f39-a586-da1ed71427c3 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:38.500285 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-96a98bfb-d0fc-4f39-a586-da1ed71427c3 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:38.506402 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-96a98bfb-d0fc-4f39-a586-da1ed71427c3 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:38.507435 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-96a98bfb-d0fc-4f39-a586-da1ed71427c3 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:38.507989 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-96a98bfb-d0fc-4f39-a586-da1ed71427c3 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:38.508717 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-96a98bfb-d0fc-4f39-a586-da1ed71427c3 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:38.509163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-96a98bfb-d0fc-4f39-a586-da1ed71427c3 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:38.509577 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-96a98bfb-d0fc-4f39-a586-da1ed71427c3 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:38.609337 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-58a464f6-a7e5-4bc3-8bef-912072716bba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:38.611327 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-58a464f6-a7e5-4bc3-8bef-912072716bba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:38.617586 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-58a464f6-a7e5-4bc3-8bef-912072716bba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:38.618057 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-58a464f6-a7e5-4bc3-8bef-912072716bba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:38.618681 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-58a464f6-a7e5-4bc3-8bef-912072716bba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:38.619365 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-58a464f6-a7e5-4bc3-8bef-912072716bba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:38.620212 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-58a464f6-a7e5-4bc3-8bef-912072716bba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:38.620934 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-58a464f6-a7e5-4bc3-8bef-912072716bba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:38.654374 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-96a98bfb-d0fc-4f39-a586-da1ed71427c3 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:38.662212 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-96a98bfb-d0fc-4f39-a586-da1ed71427c3 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.166772 Aug 31 00:35:38.663744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 42/97] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:38 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:38.757052 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-58a464f6-a7e5-4bc3-8bef-912072716bba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:38.765050 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-58a464f6-a7e5-4bc3-8bef-912072716bba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1368 microversion: 2.1 time: 0.160002 Aug 31 00:35:38.765754 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 56/98] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:38 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:38.945110 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-637028f4-6287-4837-90c2-5b17200b222c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:38.945750 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-637028f4-6287-4837-90c2-5b17200b222c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:38.951928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-637028f4-6287-4837-90c2-5b17200b222c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:38.952447 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-637028f4-6287-4837-90c2-5b17200b222c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:38.952886 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-637028f4-6287-4837-90c2-5b17200b222c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:38.953582 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-637028f4-6287-4837-90c2-5b17200b222c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:38.954033 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-637028f4-6287-4837-90c2-5b17200b222c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:38.954460 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-637028f4-6287-4837-90c2-5b17200b222c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:39.008533 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f989517c-ea4a-4fa3-9f93-b1cdf52f29dc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:39.009697 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f989517c-ea4a-4fa3-9f93-b1cdf52f29dc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:39.016526 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f989517c-ea4a-4fa3-9f93-b1cdf52f29dc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:39.017297 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f989517c-ea4a-4fa3-9f93-b1cdf52f29dc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:39.018000 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f989517c-ea4a-4fa3-9f93-b1cdf52f29dc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:39.018802 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f989517c-ea4a-4fa3-9f93-b1cdf52f29dc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:39.019541 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f989517c-ea4a-4fa3-9f93-b1cdf52f29dc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:39.020338 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f989517c-ea4a-4fa3-9f93-b1cdf52f29dc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:39.144045 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-637028f4-6287-4837-90c2-5b17200b222c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:39.158929 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-637028f4-6287-4837-90c2-5b17200b222c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.215808 Aug 31 00:35:39.169104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f989517c-ea4a-4fa3-9f93-b1cdf52f29dc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:39.174157 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 43/99] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:38 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:39.179587 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f989517c-ea4a-4fa3-9f93-b1cdf52f29dc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:39.181133 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f989517c-ea4a-4fa3-9f93-b1cdf52f29dc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:39.182537 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f989517c-ea4a-4fa3-9f93-b1cdf52f29dc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1406 microversion: 2.20 time: 0.179335 Aug 31 00:35:39.183551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 57/100] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:39 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:35:39.333502 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-d4ae8995-6ed8-482a-9830-63482f966ac2 req-b24731c1-d98a-42f2-84fe-54dd7aaee30d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71a61bc-1bd8-4191-96c6-7f7e2e4db485", "name": "network-vif-plugged", "status": "completed", "tag": "ba4bd26f-64e9-4863-a592-ab685b279ebe"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:35:39.344610 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-d4ae8995-6ed8-482a-9830-63482f966ac2 req-b24731c1-d98a-42f2-84fe-54dd7aaee30d service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:39.345082 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-d4ae8995-6ed8-482a-9830-63482f966ac2 req-b24731c1-d98a-42f2-84fe-54dd7aaee30d service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:39.345724 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-d4ae8995-6ed8-482a-9830-63482f966ac2 req-b24731c1-d98a-42f2-84fe-54dd7aaee30d service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:39.361400 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-d4ae8995-6ed8-482a-9830-63482f966ac2 req-b24731c1-d98a-42f2-84fe-54dd7aaee30d service nova] Creating event network-vif-plugged:ba4bd26f-64e9-4863-a592-ab685b279ebe for instance e71a61bc-1bd8-4191-96c6-7f7e2e4db485 on hv-cinder-85221 Aug 31 00:35:39.365687 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-d4ae8995-6ed8-482a-9830-63482f966ac2 req-b24731c1-d98a-42f2-84fe-54dd7aaee30d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036202 Aug 31 00:35:39.368762 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 44/101] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:35:39.686731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-2aaf5820-c83d-4922-94a7-bde5c788aa50 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:39.688196 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-2aaf5820-c83d-4922-94a7-bde5c788aa50 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:39.700725 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2aaf5820-c83d-4922-94a7-bde5c788aa50 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:39.701569 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2aaf5820-c83d-4922-94a7-bde5c788aa50 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:39.702254 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2aaf5820-c83d-4922-94a7-bde5c788aa50 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:39.703155 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2aaf5820-c83d-4922-94a7-bde5c788aa50 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:39.703980 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2aaf5820-c83d-4922-94a7-bde5c788aa50 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:39.704730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2aaf5820-c83d-4922-94a7-bde5c788aa50 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:39.788520 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-e679bf42-f8c2-47a0-84e5-f514ff40671a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:39.789603 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-e679bf42-f8c2-47a0-84e5-f514ff40671a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:39.801563 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e679bf42-f8c2-47a0-84e5-f514ff40671a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:39.802154 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e679bf42-f8c2-47a0-84e5-f514ff40671a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:39.804699 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e679bf42-f8c2-47a0-84e5-f514ff40671a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:39.805597 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e679bf42-f8c2-47a0-84e5-f514ff40671a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:39.806688 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e679bf42-f8c2-47a0-84e5-f514ff40671a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:39.809838 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e679bf42-f8c2-47a0-84e5-f514ff40671a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:40.046665 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-2aaf5820-c83d-4922-94a7-bde5c788aa50 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:40.057630 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-2aaf5820-c83d-4922-94a7-bde5c788aa50 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.376679 Aug 31 00:35:40.062562 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 58/102] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:39 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:40.182526 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-553c2534-de05-4e46-9d31-dcf8b18bc86f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:40.183255 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-553c2534-de05-4e46-9d31-dcf8b18bc86f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:40.191076 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-553c2534-de05-4e46-9d31-dcf8b18bc86f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:40.191826 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-553c2534-de05-4e46-9d31-dcf8b18bc86f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:40.192542 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-553c2534-de05-4e46-9d31-dcf8b18bc86f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:40.194503 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-553c2534-de05-4e46-9d31-dcf8b18bc86f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:40.197501 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-553c2534-de05-4e46-9d31-dcf8b18bc86f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:40.197501 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-553c2534-de05-4e46-9d31-dcf8b18bc86f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:40.199750 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-e679bf42-f8c2-47a0-84e5-f514ff40671a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:40.209656 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-e679bf42-f8c2-47a0-84e5-f514ff40671a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1368 microversion: 2.1 time: 0.425383 Aug 31 00:35:40.210239 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 45/103] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:39 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1368 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:40.214884 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-69018f49-b978-432f-9af3-8a76c6cea481 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:40.229440 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-69018f49-b978-432f-9af3-8a76c6cea481 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:40.235780 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-69018f49-b978-432f-9af3-8a76c6cea481 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:40.236264 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-69018f49-b978-432f-9af3-8a76c6cea481 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:40.245151 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-69018f49-b978-432f-9af3-8a76c6cea481 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:40.249744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-69018f49-b978-432f-9af3-8a76c6cea481 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:40.250330 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-69018f49-b978-432f-9af3-8a76c6cea481 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:40.250772 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-69018f49-b978-432f-9af3-8a76c6cea481 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:40.549852 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-553c2534-de05-4e46-9d31-dcf8b18bc86f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:40.558642 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-553c2534-de05-4e46-9d31-dcf8b18bc86f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.381079 Aug 31 00:35:40.559218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 59/104] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:40 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:40.701345 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-69018f49-b978-432f-9af3-8a76c6cea481 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:40.723349 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=100 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:35:40.727008 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-69018f49-b978-432f-9af3-8a76c6cea481 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:40.728561 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-69018f49-b978-432f-9af3-8a76c6cea481 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:40.730259 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-69018f49-b978-432f-9af3-8a76c6cea481 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1406 microversion: 2.20 time: 0.518528 Aug 31 00:35:40.730433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 46/105] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:40 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1406 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:35:41.062595 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-9b8ba3c5-d891-4b0c-8fc2-304a9a268c5e req-9c33fe0f-2f27-4c94-b3b5-2ca49ee56b84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64ff706f-9d6e-4268-a6db-3b4c37cf514d", "tag": "013e1a99-4ff0-465e-a5a1-038efacbed7c"}, {"name": "network-changed", "server_uuid": "dfc3d686-f358-4b8f-b983-984fd54e31e1", "tag": "e469ed11-88fc-4e04-ad53-fa40c91854d5"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:35:41.073391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-9b8ba3c5-d891-4b0c-8fc2-304a9a268c5e req-9c33fe0f-2f27-4c94-b3b5-2ca49ee56b84 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:41.074212 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-9b8ba3c5-d891-4b0c-8fc2-304a9a268c5e req-9c33fe0f-2f27-4c94-b3b5-2ca49ee56b84 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:41.074636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-9b8ba3c5-d891-4b0c-8fc2-304a9a268c5e req-9c33fe0f-2f27-4c94-b3b5-2ca49ee56b84 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:41.079498 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-979c32bc-d1e7-40e8-89f9-06514b9a584a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:41.080040 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-979c32bc-d1e7-40e8-89f9-06514b9a584a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:41.087226 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-979c32bc-d1e7-40e8-89f9-06514b9a584a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:41.087718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-979c32bc-d1e7-40e8-89f9-06514b9a584a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:41.088043 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-9b8ba3c5-d891-4b0c-8fc2-304a9a268c5e req-9c33fe0f-2f27-4c94-b3b5-2ca49ee56b84 service nova] Creating event network-changed:013e1a99-4ff0-465e-a5a1-038efacbed7c for instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d on hv-cinder-85221 Aug 31 00:35:41.088306 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-979c32bc-d1e7-40e8-89f9-06514b9a584a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:41.088564 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-9b8ba3c5-d891-4b0c-8fc2-304a9a268c5e req-9c33fe0f-2f27-4c94-b3b5-2ca49ee56b84 service nova] Creating event network-changed:e469ed11-88fc-4e04-ad53-fa40c91854d5 for instance dfc3d686-f358-4b8f-b983-984fd54e31e1 on hv-cinder-85221 Aug 31 00:35:41.089045 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-979c32bc-d1e7-40e8-89f9-06514b9a584a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:41.089496 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-979c32bc-d1e7-40e8-89f9-06514b9a584a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:41.089913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-979c32bc-d1e7-40e8-89f9-06514b9a584a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:41.108893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-9b8ba3c5-d891-4b0c-8fc2-304a9a268c5e req-9c33fe0f-2f27-4c94-b3b5-2ca49ee56b84 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049970 Aug 31 00:35:41.109498 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 60/106] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:35:41.234609 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-bf120c5c-d432-4cd1-bb14-7035fa48ffba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:41.235592 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-bf120c5c-d432-4cd1-bb14-7035fa48ffba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:41.246908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf120c5c-d432-4cd1-bb14-7035fa48ffba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:41.250202 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf120c5c-d432-4cd1-bb14-7035fa48ffba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:41.251072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf120c5c-d432-4cd1-bb14-7035fa48ffba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:41.253359 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf120c5c-d432-4cd1-bb14-7035fa48ffba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:41.253886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf120c5c-d432-4cd1-bb14-7035fa48ffba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:41.254404 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf120c5c-d432-4cd1-bb14-7035fa48ffba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:41.377169 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-979c32bc-d1e7-40e8-89f9-06514b9a584a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:41.396113 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-979c32bc-d1e7-40e8-89f9-06514b9a584a tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.320838 Aug 31 00:35:41.396731 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 47/107] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:41 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:41.404171 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-cdcb186b-8d43-43ee-9538-ad9f0b463195 req-9213c65f-05ef-4fa9-84fc-c956ff125cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6fcd7c-4829-401e-88dc-0520b01562ff", "name": "network-vif-plugged", "status": "completed", "tag": "79a597d8-aec3-4139-9872-88eb69cbc272"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:35:41.422803 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-cdcb186b-8d43-43ee-9538-ad9f0b463195 req-9213c65f-05ef-4fa9-84fc-c956ff125cbd service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:41.423632 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-cdcb186b-8d43-43ee-9538-ad9f0b463195 req-9213c65f-05ef-4fa9-84fc-c956ff125cbd service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:41.424308 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-cdcb186b-8d43-43ee-9538-ad9f0b463195 req-9213c65f-05ef-4fa9-84fc-c956ff125cbd service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:41.437671 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-cdcb186b-8d43-43ee-9538-ad9f0b463195 req-9213c65f-05ef-4fa9-84fc-c956ff125cbd service nova] Creating event network-vif-plugged:79a597d8-aec3-4139-9872-88eb69cbc272 for instance ca6fcd7c-4829-401e-88dc-0520b01562ff on hv-cinder-85221 Aug 31 00:35:41.442669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-cdcb186b-8d43-43ee-9538-ad9f0b463195 req-9213c65f-05ef-4fa9-84fc-c956ff125cbd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044010 Aug 31 00:35:41.443456 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 48/108] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:35:41.522734 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-bf120c5c-d432-4cd1-bb14-7035fa48ffba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:41.531210 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-bf120c5c-d432-4cd1-bb14-7035fa48ffba tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1368 microversion: 2.1 time: 0.303321 Aug 31 00:35:41.531814 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 61/109] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:41 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1368 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:41.581384 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-4bc53ce4-e209-444d-83c3-c0ee7eefd9d4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:41.582583 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-4bc53ce4-e209-444d-83c3-c0ee7eefd9d4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:41.589371 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4bc53ce4-e209-444d-83c3-c0ee7eefd9d4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:41.593589 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4bc53ce4-e209-444d-83c3-c0ee7eefd9d4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:41.593589 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4bc53ce4-e209-444d-83c3-c0ee7eefd9d4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:41.593589 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4bc53ce4-e209-444d-83c3-c0ee7eefd9d4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:41.593589 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4bc53ce4-e209-444d-83c3-c0ee7eefd9d4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:41.594001 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4bc53ce4-e209-444d-83c3-c0ee7eefd9d4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:41.751071 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4bc53ce4-e209-444d-83c3-c0ee7eefd9d4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:41.754198 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-68789412-c930-4b5c-a9e0-08c477038ea2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:41.755364 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-68789412-c930-4b5c-a9e0-08c477038ea2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:41.761417 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-4bc53ce4-e209-444d-83c3-c0ee7eefd9d4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.184521 Aug 31 00:35:41.762482 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 49/110] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:41 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:41.763917 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-68789412-c930-4b5c-a9e0-08c477038ea2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:41.767078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-68789412-c930-4b5c-a9e0-08c477038ea2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:41.767078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-68789412-c930-4b5c-a9e0-08c477038ea2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:41.767078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-68789412-c930-4b5c-a9e0-08c477038ea2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:41.767078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-68789412-c930-4b5c-a9e0-08c477038ea2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:41.767356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-68789412-c930-4b5c-a9e0-08c477038ea2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:41.913627 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-68789412-c930-4b5c-a9e0-08c477038ea2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:41.922671 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-68789412-c930-4b5c-a9e0-08c477038ea2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:41.924108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-68789412-c930-4b5c-a9e0-08c477038ea2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:41.925241 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-68789412-c930-4b5c-a9e0-08c477038ea2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1406 microversion: 2.20 time: 0.175198 Aug 31 00:35:41.925796 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 62/111] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:41 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:35:42.423327 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-e4357ece-4e77-4e4e-993b-34d8a0b979ac tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:42.423974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-e4357ece-4e77-4e4e-993b-34d8a0b979ac tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:42.431093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e4357ece-4e77-4e4e-993b-34d8a0b979ac tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:42.431583 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e4357ece-4e77-4e4e-993b-34d8a0b979ac tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:42.431840 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e4357ece-4e77-4e4e-993b-34d8a0b979ac tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:42.432527 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e4357ece-4e77-4e4e-993b-34d8a0b979ac tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:42.432974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e4357ece-4e77-4e4e-993b-34d8a0b979ac tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:42.433391 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e4357ece-4e77-4e4e-993b-34d8a0b979ac tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:42.554001 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b575f637-a2b6-47b7-a223-f557fd340d72 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:42.555379 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-b575f637-a2b6-47b7-a223-f557fd340d72 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:42.562031 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b575f637-a2b6-47b7-a223-f557fd340d72 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:42.574247 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b575f637-a2b6-47b7-a223-f557fd340d72 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:42.574247 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b575f637-a2b6-47b7-a223-f557fd340d72 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:42.574247 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b575f637-a2b6-47b7-a223-f557fd340d72 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:42.574247 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b575f637-a2b6-47b7-a223-f557fd340d72 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:42.574592 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b575f637-a2b6-47b7-a223-f557fd340d72 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:42.613709 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-e4357ece-4e77-4e4e-993b-34d8a0b979ac tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:42.626425 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-e4357ece-4e77-4e4e-993b-34d8a0b979ac tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1314 microversion: 2.1 time: 0.203615 Aug 31 00:35:42.627746 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 50/112] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:42 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:42.764954 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-b575f637-a2b6-47b7-a223-f557fd340d72 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:42.778701 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-b575f637-a2b6-47b7-a223-f557fd340d72 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1368 microversion: 2.1 time: 0.229274 Aug 31 00:35:42.779629 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 63/113] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:42 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:42.786431 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-77b910ab-05d0-4e4b-bc6b-6906493c795a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:42.787366 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-77b910ab-05d0-4e4b-bc6b-6906493c795a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:42.795898 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-77b910ab-05d0-4e4b-bc6b-6906493c795a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:42.796787 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-77b910ab-05d0-4e4b-bc6b-6906493c795a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:42.797228 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-77b910ab-05d0-4e4b-bc6b-6906493c795a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:42.797923 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-77b910ab-05d0-4e4b-bc6b-6906493c795a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:42.798374 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-77b910ab-05d0-4e4b-bc6b-6906493c795a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:42.799690 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-77b910ab-05d0-4e4b-bc6b-6906493c795a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:42.952887 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-dbf13477-e05c-4fbb-abac-201683550025 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:42.954317 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-dbf13477-e05c-4fbb-abac-201683550025 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:42.974445 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dbf13477-e05c-4fbb-abac-201683550025 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:42.976066 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dbf13477-e05c-4fbb-abac-201683550025 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:42.976873 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dbf13477-e05c-4fbb-abac-201683550025 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:42.978276 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dbf13477-e05c-4fbb-abac-201683550025 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:42.978812 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dbf13477-e05c-4fbb-abac-201683550025 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:42.979240 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dbf13477-e05c-4fbb-abac-201683550025 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:43.032091 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-77b910ab-05d0-4e4b-bc6b-6906493c795a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:43.041989 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-77b910ab-05d0-4e4b-bc6b-6906493c795a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.259668 Aug 31 00:35:43.042569 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 51/114] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:42 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:43.152372 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-dbf13477-e05c-4fbb-abac-201683550025 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:43.162036 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-dbf13477-e05c-4fbb-abac-201683550025 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:43.163996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-dbf13477-e05c-4fbb-abac-201683550025 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:43.165123 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-dbf13477-e05c-4fbb-abac-201683550025 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1406 microversion: 2.20 time: 0.219537 Aug 31 00:35:43.165845 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 64/115] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:42 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:35:43.652081 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-46a4aa3c-276a-4459-97f0-ce4c63a70621 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:43.652632 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-46a4aa3c-276a-4459-97f0-ce4c63a70621 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:43.658958 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-46a4aa3c-276a-4459-97f0-ce4c63a70621 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:43.659433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-46a4aa3c-276a-4459-97f0-ce4c63a70621 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:43.659861 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-46a4aa3c-276a-4459-97f0-ce4c63a70621 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:43.660571 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-46a4aa3c-276a-4459-97f0-ce4c63a70621 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:43.661016 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-46a4aa3c-276a-4459-97f0-ce4c63a70621 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:43.661431 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-46a4aa3c-276a-4459-97f0-ce4c63a70621 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:43.801357 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-46a4aa3c-276a-4459-97f0-ce4c63a70621 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:43.809422 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-46a4aa3c-276a-4459-97f0-ce4c63a70621 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1501 microversion: 2.1 time: 0.162424 Aug 31 00:35:43.809976 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 52/116] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:43 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:43.814784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a14a0885-4eeb-4c70-8254-582983d7f708 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:43.815387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a14a0885-4eeb-4c70-8254-582983d7f708 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:43.822065 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a14a0885-4eeb-4c70-8254-582983d7f708 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:43.822533 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a14a0885-4eeb-4c70-8254-582983d7f708 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:43.822953 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a14a0885-4eeb-4c70-8254-582983d7f708 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:43.823624 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a14a0885-4eeb-4c70-8254-582983d7f708 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:43.824060 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a14a0885-4eeb-4c70-8254-582983d7f708 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:43.824505 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a14a0885-4eeb-4c70-8254-582983d7f708 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:43.958086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a14a0885-4eeb-4c70-8254-582983d7f708 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:43.966454 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a14a0885-4eeb-4c70-8254-582983d7f708 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1368 microversion: 2.1 time: 0.155349 Aug 31 00:35:43.967009 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 65/117] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:43 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:44.063052 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-49e7f0ee-5432-4934-bebf-8852c92e4b64 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:44.063735 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-49e7f0ee-5432-4934-bebf-8852c92e4b64 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:44.069705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-49e7f0ee-5432-4934-bebf-8852c92e4b64 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:44.073599 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-49e7f0ee-5432-4934-bebf-8852c92e4b64 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:44.073599 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-49e7f0ee-5432-4934-bebf-8852c92e4b64 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:44.073599 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-49e7f0ee-5432-4934-bebf-8852c92e4b64 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:44.073599 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-49e7f0ee-5432-4934-bebf-8852c92e4b64 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:44.073983 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-49e7f0ee-5432-4934-bebf-8852c92e4b64 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:44.197295 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-43678339-d80c-4ae4-b0c7-71284228e5ee tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:44.197896 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-43678339-d80c-4ae4-b0c7-71284228e5ee tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:44.203793 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-43678339-d80c-4ae4-b0c7-71284228e5ee tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:44.204265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-43678339-d80c-4ae4-b0c7-71284228e5ee tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:44.205070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-43678339-d80c-4ae4-b0c7-71284228e5ee tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:44.205598 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-43678339-d80c-4ae4-b0c7-71284228e5ee tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:44.206145 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-43678339-d80c-4ae4-b0c7-71284228e5ee tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:44.206562 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-43678339-d80c-4ae4-b0c7-71284228e5ee tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:44.207835 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-49e7f0ee-5432-4934-bebf-8852c92e4b64 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:44.216451 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-49e7f0ee-5432-4934-bebf-8852c92e4b64 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.157142 Aug 31 00:35:44.217165 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 53/118] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:44 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:44.352835 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-43678339-d80c-4ae4-b0c7-71284228e5ee tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:44.361323 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-43678339-d80c-4ae4-b0c7-71284228e5ee tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:44.363078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-43678339-d80c-4ae4-b0c7-71284228e5ee tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:44.364175 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-43678339-d80c-4ae4-b0c7-71284228e5ee tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1406 microversion: 2.20 time: 0.170891 Aug 31 00:35:44.364764 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 66/119] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:44 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:35:44.990129 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-43a9cbbc-7fd8-4238-8d9c-21ed5881001d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:44.991185 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-43a9cbbc-7fd8-4238-8d9c-21ed5881001d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:44.997309 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-43a9cbbc-7fd8-4238-8d9c-21ed5881001d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:44.997797 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-43a9cbbc-7fd8-4238-8d9c-21ed5881001d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:44.998232 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-43a9cbbc-7fd8-4238-8d9c-21ed5881001d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:44.998925 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-43a9cbbc-7fd8-4238-8d9c-21ed5881001d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:44.999380 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-43a9cbbc-7fd8-4238-8d9c-21ed5881001d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:44.999797 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-43a9cbbc-7fd8-4238-8d9c-21ed5881001d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:45.139390 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-43a9cbbc-7fd8-4238-8d9c-21ed5881001d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:45.158795 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-43a9cbbc-7fd8-4238-8d9c-21ed5881001d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1368 microversion: 2.1 time: 0.174494 Aug 31 00:35:45.159386 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 54/120] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:44 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:45.239949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-34b05f6f-4810-4661-8059-58915e3008f6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:45.240782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-34b05f6f-4810-4661-8059-58915e3008f6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:45.246998 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-34b05f6f-4810-4661-8059-58915e3008f6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:45.247489 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-34b05f6f-4810-4661-8059-58915e3008f6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:45.247939 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-34b05f6f-4810-4661-8059-58915e3008f6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:45.248660 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-34b05f6f-4810-4661-8059-58915e3008f6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:45.249109 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-34b05f6f-4810-4661-8059-58915e3008f6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:45.249529 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-34b05f6f-4810-4661-8059-58915e3008f6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:45.388160 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-34b05f6f-4810-4661-8059-58915e3008f6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:45.389743 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7af327fb-01d0-44a6-b1e6-596ef2c720b1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:45.390367 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7af327fb-01d0-44a6-b1e6-596ef2c720b1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:45.396278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-34b05f6f-4810-4661-8059-58915e3008f6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.160454 Aug 31 00:35:45.396572 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7af327fb-01d0-44a6-b1e6-596ef2c720b1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:45.397790 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7af327fb-01d0-44a6-b1e6-596ef2c720b1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:45.398221 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7af327fb-01d0-44a6-b1e6-596ef2c720b1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:45.399000 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 67/121] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:45 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:45.399329 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7af327fb-01d0-44a6-b1e6-596ef2c720b1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:45.399780 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7af327fb-01d0-44a6-b1e6-596ef2c720b1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:45.400635 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7af327fb-01d0-44a6-b1e6-596ef2c720b1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:45.553495 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-7af327fb-01d0-44a6-b1e6-596ef2c720b1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:45.561866 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-7af327fb-01d0-44a6-b1e6-596ef2c720b1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:45.563307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-7af327fb-01d0-44a6-b1e6-596ef2c720b1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:45.564415 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-7af327fb-01d0-44a6-b1e6-596ef2c720b1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1406 microversion: 2.20 time: 0.178655 Aug 31 00:35:45.564964 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 55/122] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:45 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:35:46.181897 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a052f214-7a02-48ee-a653-f4428f67fe5b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:46.182558 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a052f214-7a02-48ee-a653-f4428f67fe5b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:46.202738 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a052f214-7a02-48ee-a653-f4428f67fe5b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:46.203229 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a052f214-7a02-48ee-a653-f4428f67fe5b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:46.203662 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a052f214-7a02-48ee-a653-f4428f67fe5b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:46.204382 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a052f214-7a02-48ee-a653-f4428f67fe5b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:46.207865 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a052f214-7a02-48ee-a653-f4428f67fe5b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:46.208357 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a052f214-7a02-48ee-a653-f4428f67fe5b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:46.420900 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7c30401a-554a-4add-bcfa-f8a104f41202 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:46.425423 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7c30401a-554a-4add-bcfa-f8a104f41202 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:46.430532 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7c30401a-554a-4add-bcfa-f8a104f41202 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:46.431494 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7c30401a-554a-4add-bcfa-f8a104f41202 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:46.431932 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7c30401a-554a-4add-bcfa-f8a104f41202 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:46.432811 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7c30401a-554a-4add-bcfa-f8a104f41202 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:46.433625 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7c30401a-554a-4add-bcfa-f8a104f41202 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:46.434231 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7c30401a-554a-4add-bcfa-f8a104f41202 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:46.568191 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a052f214-7a02-48ee-a653-f4428f67fe5b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:46.568191 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a052f214-7a02-48ee-a653-f4428f67fe5b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1368 microversion: 2.1 time: 0.358052 Aug 31 00:35:46.568191 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 68/123] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:46 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1368 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:46.590973 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6af409a9-37df-442c-9e78-002b43deb087 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:46.592094 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6af409a9-37df-442c-9e78-002b43deb087 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:46.599582 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6af409a9-37df-442c-9e78-002b43deb087 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:46.617610 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6af409a9-37df-442c-9e78-002b43deb087 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:46.617610 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6af409a9-37df-442c-9e78-002b43deb087 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:46.617610 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6af409a9-37df-442c-9e78-002b43deb087 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:46.617610 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6af409a9-37df-442c-9e78-002b43deb087 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:46.618179 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6af409a9-37df-442c-9e78-002b43deb087 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:46.621894 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-7c30401a-554a-4add-bcfa-f8a104f41202 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:46.630746 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-7c30401a-554a-4add-bcfa-f8a104f41202 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.214661 Aug 31 00:35:46.632824 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 56/124] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:46 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:46.774194 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6af409a9-37df-442c-9e78-002b43deb087 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:46.776971 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=100 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:35:46.780259 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6af409a9-37df-442c-9e78-002b43deb087 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:46.781703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6af409a9-37df-442c-9e78-002b43deb087 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:46.783117 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6af409a9-37df-442c-9e78-002b43deb087 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1406 microversion: 2.20 time: 0.199285 Aug 31 00:35:46.783670 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 69/125] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:46 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:35:47.579605 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-30ae45b0-0175-4ab6-8850-2c36587687a3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:47.581247 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-30ae45b0-0175-4ab6-8850-2c36587687a3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:47.583586 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:35:47.589726 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-30ae45b0-0175-4ab6-8850-2c36587687a3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:47.590226 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-30ae45b0-0175-4ab6-8850-2c36587687a3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:47.590710 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-30ae45b0-0175-4ab6-8850-2c36587687a3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:47.591548 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-30ae45b0-0175-4ab6-8850-2c36587687a3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:47.592022 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-30ae45b0-0175-4ab6-8850-2c36587687a3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:47.592590 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-30ae45b0-0175-4ab6-8850-2c36587687a3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:47.654576 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ce7479a6-9e00-44d0-bfe6-04759171de2a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:47.655881 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ce7479a6-9e00-44d0-bfe6-04759171de2a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:47.677365 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ce7479a6-9e00-44d0-bfe6-04759171de2a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:47.677365 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ce7479a6-9e00-44d0-bfe6-04759171de2a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:47.677365 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ce7479a6-9e00-44d0-bfe6-04759171de2a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:47.677365 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ce7479a6-9e00-44d0-bfe6-04759171de2a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:47.677804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ce7479a6-9e00-44d0-bfe6-04759171de2a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:47.677804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ce7479a6-9e00-44d0-bfe6-04759171de2a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:47.750684 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-30ae45b0-0175-4ab6-8850-2c36587687a3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:47.761789 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-30ae45b0-0175-4ab6-8850-2c36587687a3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1368 microversion: 2.1 time: 0.186150 Aug 31 00:35:47.763556 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 57/126] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:47 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:47.806835 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ef9b6be3-9975-4f10-8bdc-ce86d654d44b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:47.807629 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ef9b6be3-9975-4f10-8bdc-ce86d654d44b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:47.814213 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ef9b6be3-9975-4f10-8bdc-ce86d654d44b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:47.814689 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ef9b6be3-9975-4f10-8bdc-ce86d654d44b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:47.815115 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ef9b6be3-9975-4f10-8bdc-ce86d654d44b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:47.815806 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ef9b6be3-9975-4f10-8bdc-ce86d654d44b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:47.816252 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ef9b6be3-9975-4f10-8bdc-ce86d654d44b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:47.816704 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ef9b6be3-9975-4f10-8bdc-ce86d654d44b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:47.833271 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ce7479a6-9e00-44d0-bfe6-04759171de2a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:47.842812 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ce7479a6-9e00-44d0-bfe6-04759171de2a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1321 microversion: 2.1 time: 0.193224 Aug 31 00:35:47.843468 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 70/127] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:47 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:47.966085 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ef9b6be3-9975-4f10-8bdc-ce86d654d44b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:47.977743 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ef9b6be3-9975-4f10-8bdc-ce86d654d44b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:47.979606 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ef9b6be3-9975-4f10-8bdc-ce86d654d44b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:47.986483 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ef9b6be3-9975-4f10-8bdc-ce86d654d44b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1406 microversion: 2.20 time: 0.179436 Aug 31 00:35:47.986483 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 58/128] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:47 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:35:48.784547 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6dc3306d-5bca-488e-8815-7d41b08f61b2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:48.785356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6dc3306d-5bca-488e-8815-7d41b08f61b2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:48.792644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6dc3306d-5bca-488e-8815-7d41b08f61b2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:48.793127 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6dc3306d-5bca-488e-8815-7d41b08f61b2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:48.793555 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6dc3306d-5bca-488e-8815-7d41b08f61b2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:48.794653 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6dc3306d-5bca-488e-8815-7d41b08f61b2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:48.795075 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6dc3306d-5bca-488e-8815-7d41b08f61b2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:48.795491 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6dc3306d-5bca-488e-8815-7d41b08f61b2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:48.877840 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d9baa5f0-baf7-419b-a95f-dca8ced05d84 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:48.879250 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d9baa5f0-baf7-419b-a95f-dca8ced05d84 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:48.887281 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9baa5f0-baf7-419b-a95f-dca8ced05d84 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:48.887872 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9baa5f0-baf7-419b-a95f-dca8ced05d84 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:48.888392 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9baa5f0-baf7-419b-a95f-dca8ced05d84 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:48.889158 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9baa5f0-baf7-419b-a95f-dca8ced05d84 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:48.889696 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9baa5f0-baf7-419b-a95f-dca8ced05d84 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:48.890186 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9baa5f0-baf7-419b-a95f-dca8ced05d84 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:48.963915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6dc3306d-5bca-488e-8815-7d41b08f61b2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:48.976469 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6dc3306d-5bca-488e-8815-7d41b08f61b2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1368 microversion: 2.1 time: 0.195908 Aug 31 00:35:48.977812 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 71/129] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:48 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:48.998890 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c3c0ed4e-7bdb-4583-a333-3241d662adbc tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a56a86a-713c-447e-80b9-db089ba51af6"}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:35:49.006585 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c3c0ed4e-7bdb-4583-a333-3241d662adbc tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:49.019249 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c3c0ed4e-7bdb-4583-a333-3241d662adbc tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:49.020095 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c3c0ed4e-7bdb-4583-a333-3241d662adbc tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:49.020917 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c3c0ed4e-7bdb-4583-a333-3241d662adbc tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:49.022552 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c3c0ed4e-7bdb-4583-a333-3241d662adbc tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:49.023398 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c3c0ed4e-7bdb-4583-a333-3241d662adbc tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:49.024833 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c3c0ed4e-7bdb-4583-a333-3241d662adbc tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:49.071762 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d9baa5f0-baf7-419b-a95f-dca8ced05d84 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:49.081871 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d9baa5f0-baf7-419b-a95f-dca8ced05d84 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1514 microversion: 2.1 time: 0.220227 Aug 31 00:35:49.082464 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 59/130] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:48 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1514 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:49.099567 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ac1552d8-e614-46b4-af02-7124719e8d4e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:49.101052 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ac1552d8-e614-46b4-af02-7124719e8d4e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:49.111858 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ac1552d8-e614-46b4-af02-7124719e8d4e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:49.113147 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ac1552d8-e614-46b4-af02-7124719e8d4e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:49.116978 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ac1552d8-e614-46b4-af02-7124719e8d4e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:49.133734 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ac1552d8-e614-46b4-af02-7124719e8d4e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:49.133734 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ac1552d8-e614-46b4-af02-7124719e8d4e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:49.133734 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ac1552d8-e614-46b4-af02-7124719e8d4e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:49.531551 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ac1552d8-e614-46b4-af02-7124719e8d4e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:49.541461 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ac1552d8-e614-46b4-af02-7124719e8d4e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:49.543932 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ac1552d8-e614-46b4-af02-7124719e8d4e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:49.545710 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ac1552d8-e614-46b4-af02-7124719e8d4e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1406 microversion: 2.20 time: 0.461945 Aug 31 00:35:49.546669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 60/131] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:49 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1406 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:35:49.552973 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-3e57139d-8ea0-499d-a297-d2b89e1646b7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:35:49.555960 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-3e57139d-8ea0-499d-a297-d2b89e1646b7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:49.565373 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3e57139d-8ea0-499d-a297-d2b89e1646b7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:49.566379 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3e57139d-8ea0-499d-a297-d2b89e1646b7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:49.566844 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3e57139d-8ea0-499d-a297-d2b89e1646b7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:49.567630 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3e57139d-8ea0-499d-a297-d2b89e1646b7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:49.568113 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3e57139d-8ea0-499d-a297-d2b89e1646b7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:49.568623 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3e57139d-8ea0-499d-a297-d2b89e1646b7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:49.639281 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-3e57139d-8ea0-499d-a297-d2b89e1646b7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lazy-loading 'flavor' on Instance uuid ca6fcd7c-4829-401e-88dc-0520b01562ff {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:35:50.037784 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-3e57139d-8ea0-499d-a297-d2b89e1646b7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "POST /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff/action" status: 200 len: 32 microversion: 2.1 time: 0.489684 Aug 31 00:35:50.039272 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 61/132] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 00:35:49 2022] POST /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff/action => generated 32 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:35:50.047329 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-b8fce10c-d3d8-4988-80a1-965ddab4dfb4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:50.048154 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-b8fce10c-d3d8-4988-80a1-965ddab4dfb4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:50.056400 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b8fce10c-d3d8-4988-80a1-965ddab4dfb4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:50.057206 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b8fce10c-d3d8-4988-80a1-965ddab4dfb4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:50.057694 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b8fce10c-d3d8-4988-80a1-965ddab4dfb4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:50.058621 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b8fce10c-d3d8-4988-80a1-965ddab4dfb4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:50.059151 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b8fce10c-d3d8-4988-80a1-965ddab4dfb4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:50.059664 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b8fce10c-d3d8-4988-80a1-965ddab4dfb4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:50.064310 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:35:50.205684 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b8fce10c-d3d8-4988-80a1-965ddab4dfb4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:50.214699 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-b8fce10c-d3d8-4988-80a1-965ddab4dfb4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1368 microversion: 2.1 time: 0.173691 Aug 31 00:35:50.215274 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 62/133] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:50 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:50.219854 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-0c2c45e3-547b-4d6a-9d1d-8e8793a3827b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:50.220493 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-0c2c45e3-547b-4d6a-9d1d-8e8793a3827b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:50.227410 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0c2c45e3-547b-4d6a-9d1d-8e8793a3827b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:50.227897 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0c2c45e3-547b-4d6a-9d1d-8e8793a3827b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:50.228426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0c2c45e3-547b-4d6a-9d1d-8e8793a3827b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:50.229147 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0c2c45e3-547b-4d6a-9d1d-8e8793a3827b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:50.229830 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0c2c45e3-547b-4d6a-9d1d-8e8793a3827b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:50.230469 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0c2c45e3-547b-4d6a-9d1d-8e8793a3827b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:50.824404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0c2c45e3-547b-4d6a-9d1d-8e8793a3827b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:50.838512 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-0c2c45e3-547b-4d6a-9d1d-8e8793a3827b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.622185 Aug 31 00:35:50.839452 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 63/134] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:50 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:50.846057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-6a235341-71cf-48d6-83ed-f50ed2645d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:50.847446 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-6a235341-71cf-48d6-83ed-f50ed2645d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:50.855183 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6a235341-71cf-48d6-83ed-f50ed2645d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:50.856436 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6a235341-71cf-48d6-83ed-f50ed2645d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:50.857159 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6a235341-71cf-48d6-83ed-f50ed2645d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:50.858581 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6a235341-71cf-48d6-83ed-f50ed2645d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:50.859110 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6a235341-71cf-48d6-83ed-f50ed2645d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:50.859605 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6a235341-71cf-48d6-83ed-f50ed2645d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:51.251276 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-6a235341-71cf-48d6-83ed-f50ed2645d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:51.260137 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c3c0ed4e-7bdb-4583-a333-3241d662adbc tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "POST /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.265679 Aug 31 00:35:51.267820 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-6a235341-71cf-48d6-83ed-f50ed2645d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:51.273033 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-6a235341-71cf-48d6-83ed-f50ed2645d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:51.274713 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-6a235341-71cf-48d6-83ed-f50ed2645d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1406 microversion: 2.20 time: 0.434044 Aug 31 00:35:51.275805 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 64/135] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:50 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1406 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:35:51.276926 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 72/136] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 00:35:48 2022] POST /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298/os-volume_attachments => generated 194 bytes in 2283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:35:51.281214 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-18b84708-b6a4-48bb-be11-327d38c501fc tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:51.282058 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-18b84708-b6a4-48bb-be11-327d38c501fc tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:51.305987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-18b84708-b6a4-48bb-be11-327d38c501fc tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:51.305987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-18b84708-b6a4-48bb-be11-327d38c501fc tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:51.306696 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-18b84708-b6a4-48bb-be11-327d38c501fc tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:51.307423 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-18b84708-b6a4-48bb-be11-327d38c501fc tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:51.308536 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-18b84708-b6a4-48bb-be11-327d38c501fc tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:51.308968 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-18b84708-b6a4-48bb-be11-327d38c501fc tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:51.658577 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-18b84708-b6a4-48bb-be11-327d38c501fc tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:51.667312 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-18b84708-b6a4-48bb-be11-327d38c501fc tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1368 microversion: 2.1 time: 0.390049 Aug 31 00:35:51.668016 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 65/137] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:51 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1368 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:51.862379 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-12e9c5f5-aba1-49ba-bcdf-1dc32fe6821f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:51.863439 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-12e9c5f5-aba1-49ba-bcdf-1dc32fe6821f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:51.871570 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12e9c5f5-aba1-49ba-bcdf-1dc32fe6821f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:51.872410 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12e9c5f5-aba1-49ba-bcdf-1dc32fe6821f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:51.872996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12e9c5f5-aba1-49ba-bcdf-1dc32fe6821f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:51.874031 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12e9c5f5-aba1-49ba-bcdf-1dc32fe6821f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:51.874632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12e9c5f5-aba1-49ba-bcdf-1dc32fe6821f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:51.875204 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12e9c5f5-aba1-49ba-bcdf-1dc32fe6821f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:52.088727 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-12e9c5f5-aba1-49ba-bcdf-1dc32fe6821f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:52.104122 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-12e9c5f5-aba1-49ba-bcdf-1dc32fe6821f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.246942 Aug 31 00:35:52.105267 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 73/138] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:51 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:52.224169 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-b05dd27a-5f13-477d-9b53-ad188570d606 req-a3d7ce50-7446-420c-a863-7f7da7f4f66e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc3d686-f358-4b8f-b983-984fd54e31e1", "name": "network-vif-plugged", "status": "completed", "tag": "e469ed11-88fc-4e04-ad53-fa40c91854d5"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:35:52.234893 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-b05dd27a-5f13-477d-9b53-ad188570d606 req-a3d7ce50-7446-420c-a863-7f7da7f4f66e service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:52.235610 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-b05dd27a-5f13-477d-9b53-ad188570d606 req-a3d7ce50-7446-420c-a863-7f7da7f4f66e service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:52.236240 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-b05dd27a-5f13-477d-9b53-ad188570d606 req-a3d7ce50-7446-420c-a863-7f7da7f4f66e service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:52.253396 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-b05dd27a-5f13-477d-9b53-ad188570d606 req-a3d7ce50-7446-420c-a863-7f7da7f4f66e service nova] Creating event network-vif-plugged:e469ed11-88fc-4e04-ad53-fa40c91854d5 for instance dfc3d686-f358-4b8f-b983-984fd54e31e1 on hv-cinder-85221 Aug 31 00:35:52.260823 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-b05dd27a-5f13-477d-9b53-ad188570d606 req-a3d7ce50-7446-420c-a863-7f7da7f4f66e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040474 Aug 31 00:35:52.262092 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 66/139] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:35:52.300398 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-db449dca-96d2-4d88-8d99-5405c4a61fe1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:52.301105 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-db449dca-96d2-4d88-8d99-5405c4a61fe1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:52.312116 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-db449dca-96d2-4d88-8d99-5405c4a61fe1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:52.316140 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-db449dca-96d2-4d88-8d99-5405c4a61fe1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:52.316140 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-db449dca-96d2-4d88-8d99-5405c4a61fe1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:52.316140 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-db449dca-96d2-4d88-8d99-5405c4a61fe1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:52.316140 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-db449dca-96d2-4d88-8d99-5405c4a61fe1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:52.316682 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-db449dca-96d2-4d88-8d99-5405c4a61fe1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:52.619196 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-db449dca-96d2-4d88-8d99-5405c4a61fe1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:52.627792 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-db449dca-96d2-4d88-8d99-5405c4a61fe1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:52.629344 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-db449dca-96d2-4d88-8d99-5405c4a61fe1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:52.630663 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-db449dca-96d2-4d88-8d99-5405c4a61fe1 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1406 microversion: 2.20 time: 0.334597 Aug 31 00:35:52.644534 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 74/140] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:52 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:35:52.695297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a6a39b36-b629-4332-8e34-72b9da049118 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:52.696107 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-a6a39b36-b629-4332-8e34-72b9da049118 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:52.703520 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a6a39b36-b629-4332-8e34-72b9da049118 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:52.704072 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a6a39b36-b629-4332-8e34-72b9da049118 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:52.705160 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a6a39b36-b629-4332-8e34-72b9da049118 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:52.706612 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a6a39b36-b629-4332-8e34-72b9da049118 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:52.707371 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a6a39b36-b629-4332-8e34-72b9da049118 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:52.710420 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a6a39b36-b629-4332-8e34-72b9da049118 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:53.057316 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-a6a39b36-b629-4332-8e34-72b9da049118 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:53.067143 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a6a39b36-b629-4332-8e34-72b9da049118 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1368 microversion: 2.1 time: 0.377211 Aug 31 00:35:53.067730 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 67/141] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:52 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1368 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:53.128050 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3344df97-9764-4842-8821-aa252f0cb217 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:53.128795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-3344df97-9764-4842-8821-aa252f0cb217 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:53.135638 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3344df97-9764-4842-8821-aa252f0cb217 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:53.136113 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3344df97-9764-4842-8821-aa252f0cb217 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:53.136569 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3344df97-9764-4842-8821-aa252f0cb217 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:53.137256 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3344df97-9764-4842-8821-aa252f0cb217 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:53.137704 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3344df97-9764-4842-8821-aa252f0cb217 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:53.138118 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3344df97-9764-4842-8821-aa252f0cb217 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:53.320923 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-3344df97-9764-4842-8821-aa252f0cb217 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:53.334989 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-3344df97-9764-4842-8821-aa252f0cb217 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.211069 Aug 31 00:35:53.335825 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 75/142] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:53 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:53.654802 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-206bccdf-56cf-4864-b664-72a7a0e679d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:53.655529 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-206bccdf-56cf-4864-b664-72a7a0e679d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:53.662385 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-206bccdf-56cf-4864-b664-72a7a0e679d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:53.663644 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-206bccdf-56cf-4864-b664-72a7a0e679d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:53.663985 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-206bccdf-56cf-4864-b664-72a7a0e679d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:53.664892 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-206bccdf-56cf-4864-b664-72a7a0e679d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:53.665474 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-206bccdf-56cf-4864-b664-72a7a0e679d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:53.665953 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-206bccdf-56cf-4864-b664-72a7a0e679d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:53.872672 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-206bccdf-56cf-4864-b664-72a7a0e679d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:53.885020 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-206bccdf-56cf-4864-b664-72a7a0e679d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:53.886468 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-206bccdf-56cf-4864-b664-72a7a0e679d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:53.887585 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-206bccdf-56cf-4864-b664-72a7a0e679d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1406 microversion: 2.20 time: 0.237178 Aug 31 00:35:53.888139 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 68/143] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:53 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:35:54.091350 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-1c874e69-4a82-4abb-b4d5-66621542617d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:54.092251 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-1c874e69-4a82-4abb-b4d5-66621542617d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:54.098761 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1c874e69-4a82-4abb-b4d5-66621542617d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:54.099411 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1c874e69-4a82-4abb-b4d5-66621542617d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:54.100265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1c874e69-4a82-4abb-b4d5-66621542617d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:54.101511 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1c874e69-4a82-4abb-b4d5-66621542617d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:54.102135 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1c874e69-4a82-4abb-b4d5-66621542617d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:54.104123 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1c874e69-4a82-4abb-b4d5-66621542617d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:54.265452 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-1c874e69-4a82-4abb-b4d5-66621542617d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:54.275102 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-1c874e69-4a82-4abb-b4d5-66621542617d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1368 microversion: 2.1 time: 0.188337 Aug 31 00:35:54.277733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 76/144] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:54 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:54.326949 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-2d90a2d8-f17a-41f5-b8c4-38ca01754e76 req-af9d7df7-b858-437f-8e3e-9ae556d11f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64ff706f-9d6e-4268-a6db-3b4c37cf514d", "name": "network-vif-plugged", "status": "completed", "tag": "013e1a99-4ff0-465e-a5a1-038efacbed7c"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:35:54.340499 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-2d90a2d8-f17a-41f5-b8c4-38ca01754e76 req-af9d7df7-b858-437f-8e3e-9ae556d11f56 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:54.340962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-2d90a2d8-f17a-41f5-b8c4-38ca01754e76 req-af9d7df7-b858-437f-8e3e-9ae556d11f56 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:54.341376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-2d90a2d8-f17a-41f5-b8c4-38ca01754e76 req-af9d7df7-b858-437f-8e3e-9ae556d11f56 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:54.357292 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a82e3679-d45d-4e5c-978f-e559de7879c8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:54.358911 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a82e3679-d45d-4e5c-978f-e559de7879c8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:54.367461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a82e3679-d45d-4e5c-978f-e559de7879c8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:54.367692 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-2d90a2d8-f17a-41f5-b8c4-38ca01754e76 req-af9d7df7-b858-437f-8e3e-9ae556d11f56 service nova] Creating event network-vif-plugged:013e1a99-4ff0-465e-a5a1-038efacbed7c for instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d on hv-cinder-85221 Aug 31 00:35:54.368050 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a82e3679-d45d-4e5c-978f-e559de7879c8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:54.369338 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a82e3679-d45d-4e5c-978f-e559de7879c8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:54.370120 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a82e3679-d45d-4e5c-978f-e559de7879c8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:54.370643 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a82e3679-d45d-4e5c-978f-e559de7879c8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:54.371633 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a82e3679-d45d-4e5c-978f-e559de7879c8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:54.382437 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-2d90a2d8-f17a-41f5-b8c4-38ca01754e76 req-af9d7df7-b858-437f-8e3e-9ae556d11f56 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067895 Aug 31 00:35:54.392714 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 69/145] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:35:54.561507 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a82e3679-d45d-4e5c-978f-e559de7879c8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:54.566504 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a82e3679-d45d-4e5c-978f-e559de7879c8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.212990 Aug 31 00:35:54.567125 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 77/146] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:54 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:54.911784 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-fb064dd4-a269-485e-bff6-f578ca5b9893 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:54.914073 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-fb064dd4-a269-485e-bff6-f578ca5b9893 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:54.921643 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fb064dd4-a269-485e-bff6-f578ca5b9893 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:54.922175 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fb064dd4-a269-485e-bff6-f578ca5b9893 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:54.922565 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fb064dd4-a269-485e-bff6-f578ca5b9893 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:54.923262 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fb064dd4-a269-485e-bff6-f578ca5b9893 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:54.923709 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fb064dd4-a269-485e-bff6-f578ca5b9893 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:54.924122 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fb064dd4-a269-485e-bff6-f578ca5b9893 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:55.129303 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fb064dd4-a269-485e-bff6-f578ca5b9893 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:55.137996 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fb064dd4-a269-485e-bff6-f578ca5b9893 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:55.139693 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fb064dd4-a269-485e-bff6-f578ca5b9893 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:55.140899 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-fb064dd4-a269-485e-bff6-f578ca5b9893 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1406 microversion: 2.20 time: 0.233580 Aug 31 00:35:55.141652 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 70/147] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:54 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:35:55.316051 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6e27ffc5-571c-49bd-a05d-1e549d525f38 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:55.316992 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6e27ffc5-571c-49bd-a05d-1e549d525f38 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:55.326379 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6e27ffc5-571c-49bd-a05d-1e549d525f38 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:55.327204 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6e27ffc5-571c-49bd-a05d-1e549d525f38 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:55.327641 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6e27ffc5-571c-49bd-a05d-1e549d525f38 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:55.328489 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6e27ffc5-571c-49bd-a05d-1e549d525f38 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:55.328979 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6e27ffc5-571c-49bd-a05d-1e549d525f38 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:55.329365 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6e27ffc5-571c-49bd-a05d-1e549d525f38 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:55.532872 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6e27ffc5-571c-49bd-a05d-1e549d525f38 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:55.542278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6e27ffc5-571c-49bd-a05d-1e549d525f38 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1368 microversion: 2.1 time: 0.229884 Aug 31 00:35:55.549425 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 78/148] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:55 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:55.587631 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-dacf8f4d-1472-4e75-94e1-3c31adeac31d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:55.588246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-dacf8f4d-1472-4e75-94e1-3c31adeac31d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:55.599674 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-dacf8f4d-1472-4e75-94e1-3c31adeac31d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:55.600805 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-dacf8f4d-1472-4e75-94e1-3c31adeac31d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:55.601237 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-dacf8f4d-1472-4e75-94e1-3c31adeac31d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:55.605600 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-dacf8f4d-1472-4e75-94e1-3c31adeac31d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:55.608901 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-dacf8f4d-1472-4e75-94e1-3c31adeac31d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:55.618541 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-dacf8f4d-1472-4e75-94e1-3c31adeac31d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:55.793713 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-dacf8f4d-1472-4e75-94e1-3c31adeac31d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:55.801717 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-dacf8f4d-1472-4e75-94e1-3c31adeac31d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.218430 Aug 31 00:35:55.808392 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 71/149] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:55 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:56.166350 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-09d72fee-030d-43e5-a030-0dc4ec262b39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:56.167256 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-09d72fee-030d-43e5-a030-0dc4ec262b39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:56.170568 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=100 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:35:56.174404 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-09d72fee-030d-43e5-a030-0dc4ec262b39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:56.175819 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-09d72fee-030d-43e5-a030-0dc4ec262b39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:56.176060 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-09d72fee-030d-43e5-a030-0dc4ec262b39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:56.176901 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-09d72fee-030d-43e5-a030-0dc4ec262b39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:56.177483 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-09d72fee-030d-43e5-a030-0dc4ec262b39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:56.178400 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-09d72fee-030d-43e5-a030-0dc4ec262b39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:56.322475 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-09d72fee-030d-43e5-a030-0dc4ec262b39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:56.331112 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-09d72fee-030d-43e5-a030-0dc4ec262b39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:56.332581 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-09d72fee-030d-43e5-a030-0dc4ec262b39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:56.334265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-09d72fee-030d-43e5-a030-0dc4ec262b39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1598 microversion: 2.20 time: 0.172331 Aug 31 00:35:56.334826 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 79/150] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:35:56 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1598 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:35:56.358436 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-507f45a5-02ad-4cb4-af4e-e248125c7b4b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:56.359346 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-507f45a5-02ad-4cb4-af4e-e248125c7b4b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:56.367114 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-507f45a5-02ad-4cb4-af4e-e248125c7b4b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:56.367708 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-507f45a5-02ad-4cb4-af4e-e248125c7b4b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:56.368179 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-507f45a5-02ad-4cb4-af4e-e248125c7b4b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:56.369228 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-507f45a5-02ad-4cb4-af4e-e248125c7b4b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:56.369767 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-507f45a5-02ad-4cb4-af4e-e248125c7b4b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:56.370301 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-507f45a5-02ad-4cb4-af4e-e248125c7b4b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:56.524852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-507f45a5-02ad-4cb4-af4e-e248125c7b4b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.167167 Aug 31 00:35:56.525881 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 72/151] 10.222.0.65 () {60 vars in 1316 bytes} [Wed Aug 31 00:35:56 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:35:56.573955 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-51529fb2-e211-419f-ace5-0e3cf33c565c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:56.575105 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-51529fb2-e211-419f-ace5-0e3cf33c565c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:56.581606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-51529fb2-e211-419f-ace5-0e3cf33c565c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:56.582103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-51529fb2-e211-419f-ace5-0e3cf33c565c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:56.582588 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-51529fb2-e211-419f-ace5-0e3cf33c565c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:56.583292 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-51529fb2-e211-419f-ace5-0e3cf33c565c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:56.584701 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-51529fb2-e211-419f-ace5-0e3cf33c565c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:56.585132 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-51529fb2-e211-419f-ace5-0e3cf33c565c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:56.829266 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-b7b273b3-9f7f-4200-a997-1e8021e3f7cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:56.832700 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-b7b273b3-9f7f-4200-a997-1e8021e3f7cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:56.848908 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b7b273b3-9f7f-4200-a997-1e8021e3f7cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:56.850392 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b7b273b3-9f7f-4200-a997-1e8021e3f7cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:56.851409 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b7b273b3-9f7f-4200-a997-1e8021e3f7cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:56.852497 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b7b273b3-9f7f-4200-a997-1e8021e3f7cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:56.853173 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b7b273b3-9f7f-4200-a997-1e8021e3f7cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:56.854111 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b7b273b3-9f7f-4200-a997-1e8021e3f7cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:56.925684 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-51529fb2-e211-419f-ace5-0e3cf33c565c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:56.940133 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-51529fb2-e211-419f-ace5-0e3cf33c565c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1368 microversion: 2.1 time: 0.370087 Aug 31 00:35:56.956565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 80/152] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:56 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1368 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:57.061663 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b7b273b3-9f7f-4200-a997-1e8021e3f7cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:57.077013 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-b7b273b3-9f7f-4200-a997-1e8021e3f7cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.256236 Aug 31 00:35:57.079727 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 73/153] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:56 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:35:57.965023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-11c14cab-03df-41c1-9d7c-b63cb2d99efd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:57.965639 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-11c14cab-03df-41c1-9d7c-b63cb2d99efd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:57.979400 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-11c14cab-03df-41c1-9d7c-b63cb2d99efd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:57.981032 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-11c14cab-03df-41c1-9d7c-b63cb2d99efd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:57.981652 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-11c14cab-03df-41c1-9d7c-b63cb2d99efd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:57.982553 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-11c14cab-03df-41c1-9d7c-b63cb2d99efd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:57.983384 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-11c14cab-03df-41c1-9d7c-b63cb2d99efd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:57.986763 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-11c14cab-03df-41c1-9d7c-b63cb2d99efd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:58.101081 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c52eed7f-78fd-42e9-9c52-11cec440fbaf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:58.102488 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c52eed7f-78fd-42e9-9c52-11cec440fbaf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:58.111676 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c52eed7f-78fd-42e9-9c52-11cec440fbaf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:58.112356 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c52eed7f-78fd-42e9-9c52-11cec440fbaf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:58.113047 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c52eed7f-78fd-42e9-9c52-11cec440fbaf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:58.114010 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c52eed7f-78fd-42e9-9c52-11cec440fbaf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:58.114664 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c52eed7f-78fd-42e9-9c52-11cec440fbaf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:58.115901 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c52eed7f-78fd-42e9-9c52-11cec440fbaf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:58.297384 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-11c14cab-03df-41c1-9d7c-b63cb2d99efd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:58.311424 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-11c14cab-03df-41c1-9d7c-b63cb2d99efd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1368 microversion: 2.1 time: 0.350156 Aug 31 00:35:58.315222 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 81/154] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:57 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1368 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:58.588816 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c52eed7f-78fd-42e9-9c52-11cec440fbaf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:58.609971 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-c52eed7f-78fd-42e9-9c52-11cec440fbaf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.513201 Aug 31 00:35:58.612871 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 74/155] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:58 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:59.336742 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-1055d38a-a841-4abe-b2bd-6fe9aa5afe2a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:59.338563 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-1055d38a-a841-4abe-b2bd-6fe9aa5afe2a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:59.357185 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1055d38a-a841-4abe-b2bd-6fe9aa5afe2a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:59.358037 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1055d38a-a841-4abe-b2bd-6fe9aa5afe2a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:59.358693 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1055d38a-a841-4abe-b2bd-6fe9aa5afe2a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:59.360670 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1055d38a-a841-4abe-b2bd-6fe9aa5afe2a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:59.361674 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1055d38a-a841-4abe-b2bd-6fe9aa5afe2a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:59.362599 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1055d38a-a841-4abe-b2bd-6fe9aa5afe2a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:59.424117 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-73ac23d6-154e-4f18-bb08-8d5a624f58d2 req-eeb0467d-f8b8-4815-8919-6074cc19b9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfc3d686-f358-4b8f-b983-984fd54e31e1", "tag": "e469ed11-88fc-4e04-ad53-fa40c91854d5"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:35:59.438337 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-73ac23d6-154e-4f18-bb08-8d5a624f58d2 req-eeb0467d-f8b8-4815-8919-6074cc19b9d4 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:59.444733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-73ac23d6-154e-4f18-bb08-8d5a624f58d2 req-eeb0467d-f8b8-4815-8919-6074cc19b9d4 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:59.444733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-73ac23d6-154e-4f18-bb08-8d5a624f58d2 req-eeb0467d-f8b8-4815-8919-6074cc19b9d4 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:59.452026 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-73ac23d6-154e-4f18-bb08-8d5a624f58d2 req-eeb0467d-f8b8-4815-8919-6074cc19b9d4 service nova] Creating event network-changed:e469ed11-88fc-4e04-ad53-fa40c91854d5 for instance dfc3d686-f358-4b8f-b983-984fd54e31e1 on hv-cinder-85221 Aug 31 00:35:59.457986 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-73ac23d6-154e-4f18-bb08-8d5a624f58d2 req-eeb0467d-f8b8-4815-8919-6074cc19b9d4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.429019 Aug 31 00:35:59.463454 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 82/156] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:35:59.626375 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-1055d38a-a841-4abe-b2bd-6fe9aa5afe2a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:59.636059 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-1055d38a-a841-4abe-b2bd-6fe9aa5afe2a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1558 microversion: 2.1 time: 0.305345 Aug 31 00:35:59.636763 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 75/157] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:59 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1558 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:35:59.638937 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-5a17d299-64ee-4791-b5e9-88e4b6aac726 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:59.640034 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-5a17d299-64ee-4791-b5e9-88e4b6aac726 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:59.648892 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5a17d299-64ee-4791-b5e9-88e4b6aac726 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:59.649498 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5a17d299-64ee-4791-b5e9-88e4b6aac726 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:59.649996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5a17d299-64ee-4791-b5e9-88e4b6aac726 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:59.650794 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5a17d299-64ee-4791-b5e9-88e4b6aac726 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:59.651696 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5a17d299-64ee-4791-b5e9-88e4b6aac726 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:59.652231 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5a17d299-64ee-4791-b5e9-88e4b6aac726 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:59.659760 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a8c9cb77-4ca9-4b21-ae53-6149cc7b3fd8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:35:59.660255 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-a8c9cb77-4ca9-4b21-ae53-6149cc7b3fd8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:35:59.668566 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a8c9cb77-4ca9-4b21-ae53-6149cc7b3fd8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:59.668566 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a8c9cb77-4ca9-4b21-ae53-6149cc7b3fd8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:59.668945 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a8c9cb77-4ca9-4b21-ae53-6149cc7b3fd8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:59.669646 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a8c9cb77-4ca9-4b21-ae53-6149cc7b3fd8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:35:59.670293 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a8c9cb77-4ca9-4b21-ae53-6149cc7b3fd8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:35:59.670859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a8c9cb77-4ca9-4b21-ae53-6149cc7b3fd8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:35:59.835844 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-5a17d299-64ee-4791-b5e9-88e4b6aac726 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:35:59.848043 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a8c9cb77-4ca9-4b21-ae53-6149cc7b3fd8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.192394 Aug 31 00:35:59.848675 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 76/158] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 31 00:35:59 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d/os-interface => generated 285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:35:59.876145 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-5a17d299-64ee-4791-b5e9-88e4b6aac726 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.232687 Aug 31 00:35:59.878062 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 83/159] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:35:59 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:36:00.902057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-73065b40-5848-4853-9b6f-87988049a44d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:00.902789 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-73065b40-5848-4853-9b6f-87988049a44d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:00.909309 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-73065b40-5848-4853-9b6f-87988049a44d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:00.909757 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-73065b40-5848-4853-9b6f-87988049a44d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:00.910895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-73065b40-5848-4853-9b6f-87988049a44d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:00.911685 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-73065b40-5848-4853-9b6f-87988049a44d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:00.912243 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-73065b40-5848-4853-9b6f-87988049a44d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:00.912773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-73065b40-5848-4853-9b6f-87988049a44d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:01.122853 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-73065b40-5848-4853-9b6f-87988049a44d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:01.132450 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-73065b40-5848-4853-9b6f-87988049a44d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.235416 Aug 31 00:36:01.133414 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 77/160] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:00 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:01.475510 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-7bff6583-ad83-443b-9525-d30783f404f8 req-57262d44-29d3-4143-a669-941276c54f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64ff706f-9d6e-4268-a6db-3b4c37cf514d", "tag": "013e1a99-4ff0-465e-a5a1-038efacbed7c"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:36:01.493837 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-7bff6583-ad83-443b-9525-d30783f404f8 req-57262d44-29d3-4143-a669-941276c54f77 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:01.494320 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-7bff6583-ad83-443b-9525-d30783f404f8 req-57262d44-29d3-4143-a669-941276c54f77 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:01.494749 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-7bff6583-ad83-443b-9525-d30783f404f8 req-57262d44-29d3-4143-a669-941276c54f77 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:01.518948 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-7bff6583-ad83-443b-9525-d30783f404f8 req-57262d44-29d3-4143-a669-941276c54f77 service nova] Creating event network-changed:013e1a99-4ff0-465e-a5a1-038efacbed7c for instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d on hv-cinder-85221 Aug 31 00:36:01.524882 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-7bff6583-ad83-443b-9525-d30783f404f8 req-57262d44-29d3-4143-a669-941276c54f77 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053447 Aug 31 00:36:01.525763 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 84/161] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:36:02.155459 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-112fbf38-5bea-4305-aaad-08f12494d41a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:02.156072 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-112fbf38-5bea-4305-aaad-08f12494d41a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:02.158493 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=96 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:02.163968 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-112fbf38-5bea-4305-aaad-08f12494d41a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:02.166214 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-112fbf38-5bea-4305-aaad-08f12494d41a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:02.167066 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-112fbf38-5bea-4305-aaad-08f12494d41a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:02.169872 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-112fbf38-5bea-4305-aaad-08f12494d41a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:02.169872 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-112fbf38-5bea-4305-aaad-08f12494d41a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:02.169872 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-112fbf38-5bea-4305-aaad-08f12494d41a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:02.476575 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-112fbf38-5bea-4305-aaad-08f12494d41a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:02.487527 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-112fbf38-5bea-4305-aaad-08f12494d41a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.335507 Aug 31 00:36:02.488840 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 78/162] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:02 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:02.735816 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6861353e-519f-4169-8cd5-2ae4545ef030 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:02.736530 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6861353e-519f-4169-8cd5-2ae4545ef030 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:02.743046 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6861353e-519f-4169-8cd5-2ae4545ef030 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:02.743515 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6861353e-519f-4169-8cd5-2ae4545ef030 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:02.743946 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6861353e-519f-4169-8cd5-2ae4545ef030 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:02.744653 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6861353e-519f-4169-8cd5-2ae4545ef030 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:02.745097 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6861353e-519f-4169-8cd5-2ae4545ef030 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:02.745509 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6861353e-519f-4169-8cd5-2ae4545ef030 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:02.772716 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6861353e-519f-4169-8cd5-2ae4545ef030 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Going to try to terminate instance {{(pid=128049) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:36:02.806915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:03.094284 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6861353e-519f-4169-8cd5-2ae4545ef030 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "DELETE /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 204 len: 0 microversion: 2.1 time: 0.363131 Aug 31 00:36:03.094875 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 85/163] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:36:02 2022] DELETE /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:36:03.103962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-3fcb53ba-f3e0-429e-8ade-974ba1ef6716 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:03.104610 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-3fcb53ba-f3e0-429e-8ade-974ba1ef6716 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:03.110635 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3fcb53ba-f3e0-429e-8ade-974ba1ef6716 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:03.111098 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3fcb53ba-f3e0-429e-8ade-974ba1ef6716 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:03.111530 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3fcb53ba-f3e0-429e-8ade-974ba1ef6716 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:03.112221 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3fcb53ba-f3e0-429e-8ade-974ba1ef6716 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:03.112695 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3fcb53ba-f3e0-429e-8ade-974ba1ef6716 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:03.113116 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3fcb53ba-f3e0-429e-8ade-974ba1ef6716 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:03.266540 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-3fcb53ba-f3e0-429e-8ade-974ba1ef6716 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:03.275867 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-3fcb53ba-f3e0-429e-8ade-974ba1ef6716 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1553 microversion: 2.1 time: 0.176601 Aug 31 00:36:03.276452 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 79/164] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:03 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:03.513224 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c31acf2c-570c-4d97-8dba-7d9be5d9cf6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:03.514043 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c31acf2c-570c-4d97-8dba-7d9be5d9cf6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:03.525213 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c31acf2c-570c-4d97-8dba-7d9be5d9cf6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:03.525213 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c31acf2c-570c-4d97-8dba-7d9be5d9cf6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:03.525213 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c31acf2c-570c-4d97-8dba-7d9be5d9cf6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:03.525213 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c31acf2c-570c-4d97-8dba-7d9be5d9cf6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:03.525496 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c31acf2c-570c-4d97-8dba-7d9be5d9cf6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:03.525496 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c31acf2c-570c-4d97-8dba-7d9be5d9cf6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:03.666829 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-c31acf2c-570c-4d97-8dba-7d9be5d9cf6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:03.675595 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c31acf2c-570c-4d97-8dba-7d9be5d9cf6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.167057 Aug 31 00:36:03.685050 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 86/165] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:03 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:36:04.298244 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-16ad9d8c-520a-4f5d-945a-6ba03998b983 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:04.298880 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-16ad9d8c-520a-4f5d-945a-6ba03998b983 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:04.308706 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-16ad9d8c-520a-4f5d-945a-6ba03998b983 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:04.309184 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-16ad9d8c-520a-4f5d-945a-6ba03998b983 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:04.309624 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-16ad9d8c-520a-4f5d-945a-6ba03998b983 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:04.310334 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-16ad9d8c-520a-4f5d-945a-6ba03998b983 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:04.310781 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-16ad9d8c-520a-4f5d-945a-6ba03998b983 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:04.311211 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-16ad9d8c-520a-4f5d-945a-6ba03998b983 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:04.461726 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-16ad9d8c-520a-4f5d-945a-6ba03998b983 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:04.465455 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=100 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:04.470708 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-16ad9d8c-520a-4f5d-945a-6ba03998b983 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1553 microversion: 2.1 time: 0.176512 Aug 31 00:36:04.471278 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 80/166] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:04 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:04.701602 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6da8470c-2e60-478e-aff9-bde6d0a1a009 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:04.702238 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6da8470c-2e60-478e-aff9-bde6d0a1a009 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:04.708990 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6da8470c-2e60-478e-aff9-bde6d0a1a009 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:04.709647 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6da8470c-2e60-478e-aff9-bde6d0a1a009 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:04.710027 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6da8470c-2e60-478e-aff9-bde6d0a1a009 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:04.710720 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6da8470c-2e60-478e-aff9-bde6d0a1a009 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:04.711171 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6da8470c-2e60-478e-aff9-bde6d0a1a009 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:04.711593 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6da8470c-2e60-478e-aff9-bde6d0a1a009 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:04.869272 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6da8470c-2e60-478e-aff9-bde6d0a1a009 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:04.876823 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6da8470c-2e60-478e-aff9-bde6d0a1a009 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.179352 Aug 31 00:36:04.877387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 87/167] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:04 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:05.492991 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9be2b940-b32e-46f7-8587-92aab2e5466c tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:05.493606 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9be2b940-b32e-46f7-8587-92aab2e5466c tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:05.500113 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9be2b940-b32e-46f7-8587-92aab2e5466c tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:05.500630 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9be2b940-b32e-46f7-8587-92aab2e5466c tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:05.501055 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9be2b940-b32e-46f7-8587-92aab2e5466c tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:05.501735 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9be2b940-b32e-46f7-8587-92aab2e5466c tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:05.502183 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9be2b940-b32e-46f7-8587-92aab2e5466c tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:05.502592 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9be2b940-b32e-46f7-8587-92aab2e5466c tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:05.636277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-9be2b940-b32e-46f7-8587-92aab2e5466c tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:05.644753 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9be2b940-b32e-46f7-8587-92aab2e5466c tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1553 microversion: 2.1 time: 0.155912 Aug 31 00:36:05.645392 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 81/168] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:05 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:05.899919 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-aef3f08e-696a-4d71-b71d-2d57616f328d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:05.900577 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-aef3f08e-696a-4d71-b71d-2d57616f328d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:05.907491 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aef3f08e-696a-4d71-b71d-2d57616f328d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:05.907975 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aef3f08e-696a-4d71-b71d-2d57616f328d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:05.908442 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aef3f08e-696a-4d71-b71d-2d57616f328d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:05.909150 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aef3f08e-696a-4d71-b71d-2d57616f328d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:05.909593 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aef3f08e-696a-4d71-b71d-2d57616f328d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:05.911708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aef3f08e-696a-4d71-b71d-2d57616f328d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:06.164931 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-aef3f08e-696a-4d71-b71d-2d57616f328d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:06.172587 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-aef3f08e-696a-4d71-b71d-2d57616f328d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.277823 Aug 31 00:36:06.173156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 88/169] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:05 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:06.667566 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-af0a8d6f-625a-4713-ba1c-ed5d4c44c323 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:06.669625 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-af0a8d6f-625a-4713-ba1c-ed5d4c44c323 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:06.675035 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-af0a8d6f-625a-4713-ba1c-ed5d4c44c323 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:06.675536 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-af0a8d6f-625a-4713-ba1c-ed5d4c44c323 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:06.675993 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-af0a8d6f-625a-4713-ba1c-ed5d4c44c323 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:06.676740 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-af0a8d6f-625a-4713-ba1c-ed5d4c44c323 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:06.677850 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-af0a8d6f-625a-4713-ba1c-ed5d4c44c323 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:06.678271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-af0a8d6f-625a-4713-ba1c-ed5d4c44c323 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:06.856834 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-af0a8d6f-625a-4713-ba1c-ed5d4c44c323 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:06.865469 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-af0a8d6f-625a-4713-ba1c-ed5d4c44c323 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1553 microversion: 2.1 time: 0.201787 Aug 31 00:36:06.866692 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 82/170] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:06 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1553 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:07.194794 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-bc7b6eee-8d1e-415f-a4d4-290ebdabbdec tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:07.195307 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-bc7b6eee-8d1e-415f-a4d4-290ebdabbdec tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:07.201786 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bc7b6eee-8d1e-415f-a4d4-290ebdabbdec tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:07.202271 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bc7b6eee-8d1e-415f-a4d4-290ebdabbdec tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:07.202710 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bc7b6eee-8d1e-415f-a4d4-290ebdabbdec tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:07.203523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bc7b6eee-8d1e-415f-a4d4-290ebdabbdec tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:07.203841 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bc7b6eee-8d1e-415f-a4d4-290ebdabbdec tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:07.204285 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bc7b6eee-8d1e-415f-a4d4-290ebdabbdec tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:07.444910 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-bc7b6eee-8d1e-415f-a4d4-290ebdabbdec tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:07.453494 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-bc7b6eee-8d1e-415f-a4d4-290ebdabbdec tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.262853 Aug 31 00:36:07.454075 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 89/171] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:07 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:07.888245 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-06aa8f8c-aca8-47e8-84cd-0177654c929f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:07.889578 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-06aa8f8c-aca8-47e8-84cd-0177654c929f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:07.897644 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-06aa8f8c-aca8-47e8-84cd-0177654c929f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:07.898676 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-06aa8f8c-aca8-47e8-84cd-0177654c929f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:07.899370 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-06aa8f8c-aca8-47e8-84cd-0177654c929f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:07.900288 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-06aa8f8c-aca8-47e8-84cd-0177654c929f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:07.900936 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-06aa8f8c-aca8-47e8-84cd-0177654c929f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:07.901531 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-06aa8f8c-aca8-47e8-84cd-0177654c929f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:08.061442 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-06aa8f8c-aca8-47e8-84cd-0177654c929f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:08.073985 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-06aa8f8c-aca8-47e8-84cd-0177654c929f tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1553 microversion: 2.1 time: 0.188233 Aug 31 00:36:08.085312 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 83/172] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:07 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:08.478423 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d48f82ab-db60-47b3-8c88-8f72870d60fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:08.479908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d48f82ab-db60-47b3-8c88-8f72870d60fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:08.489421 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d48f82ab-db60-47b3-8c88-8f72870d60fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:08.490616 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d48f82ab-db60-47b3-8c88-8f72870d60fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:08.491300 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d48f82ab-db60-47b3-8c88-8f72870d60fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:08.492445 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d48f82ab-db60-47b3-8c88-8f72870d60fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:08.493162 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d48f82ab-db60-47b3-8c88-8f72870d60fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:08.493774 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d48f82ab-db60-47b3-8c88-8f72870d60fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:08.711889 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d48f82ab-db60-47b3-8c88-8f72870d60fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:08.723627 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d48f82ab-db60-47b3-8c88-8f72870d60fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.252311 Aug 31 00:36:08.727062 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 90/173] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:08 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:09.098099 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-4d9d51ab-b30d-4253-9ad5-88e01df0d956 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:09.098858 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-4d9d51ab-b30d-4253-9ad5-88e01df0d956 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:09.105863 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4d9d51ab-b30d-4253-9ad5-88e01df0d956 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:09.106399 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4d9d51ab-b30d-4253-9ad5-88e01df0d956 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:09.106833 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4d9d51ab-b30d-4253-9ad5-88e01df0d956 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:09.107516 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4d9d51ab-b30d-4253-9ad5-88e01df0d956 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:09.108599 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4d9d51ab-b30d-4253-9ad5-88e01df0d956 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:09.109403 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4d9d51ab-b30d-4253-9ad5-88e01df0d956 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:09.743351 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4d9d51ab-b30d-4253-9ad5-88e01df0d956 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:09.756360 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-04562da6-cc3a-4ab3-b758-7ccaed797741 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:09.757068 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-04562da6-cc3a-4ab3-b758-7ccaed797741 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:09.761277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-4d9d51ab-b30d-4253-9ad5-88e01df0d956 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1553 microversion: 2.1 time: 0.668046 Aug 31 00:36:09.766875 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-04562da6-cc3a-4ab3-b758-7ccaed797741 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:09.767604 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-04562da6-cc3a-4ab3-b758-7ccaed797741 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:09.776234 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-04562da6-cc3a-4ab3-b758-7ccaed797741 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:09.777436 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-04562da6-cc3a-4ab3-b758-7ccaed797741 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:09.778084 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-04562da6-cc3a-4ab3-b758-7ccaed797741 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:09.778686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-04562da6-cc3a-4ab3-b758-7ccaed797741 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:09.780680 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 84/174] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:09 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1553 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:36:10.023277 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-04562da6-cc3a-4ab3-b758-7ccaed797741 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:10.035930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-04562da6-cc3a-4ab3-b758-7ccaed797741 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.281316 Aug 31 00:36:10.043885 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 91/175] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:09 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:10.125231 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-a42ab73e-6cc5-4c99-a0ac-132d4b8b7092 req-087c7dd0-8c30-4aeb-b07e-ad26fc9bd782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31dd6cf1-78b5-438d-95ce-aa6229958298", "name": "network-vif-deleted", "tag": "6033d17d-748b-4a2e-b40d-29f917390834"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:36:10.149363 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-a42ab73e-6cc5-4c99-a0ac-132d4b8b7092 req-087c7dd0-8c30-4aeb-b07e-ad26fc9bd782 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:10.150213 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-a42ab73e-6cc5-4c99-a0ac-132d4b8b7092 req-087c7dd0-8c30-4aeb-b07e-ad26fc9bd782 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:10.150862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-a42ab73e-6cc5-4c99-a0ac-132d4b8b7092 req-087c7dd0-8c30-4aeb-b07e-ad26fc9bd782 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:10.178551 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-a42ab73e-6cc5-4c99-a0ac-132d4b8b7092 req-087c7dd0-8c30-4aeb-b07e-ad26fc9bd782 service nova] Creating event network-vif-deleted:6033d17d-748b-4a2e-b40d-29f917390834 for instance 31dd6cf1-78b5-438d-95ce-aa6229958298 on hv-cinder-85221 Aug 31 00:36:10.196749 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-a42ab73e-6cc5-4c99-a0ac-132d4b8b7092 req-087c7dd0-8c30-4aeb-b07e-ad26fc9bd782 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075623 Aug 31 00:36:10.197400 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 85/176] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:36:10.788619 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c6cafa52-277b-4435-85f1-c645d94232c7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:10.789756 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c6cafa52-277b-4435-85f1-c645d94232c7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:10.801272 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c6cafa52-277b-4435-85f1-c645d94232c7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:10.802430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c6cafa52-277b-4435-85f1-c645d94232c7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:10.803602 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c6cafa52-277b-4435-85f1-c645d94232c7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:10.804385 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c6cafa52-277b-4435-85f1-c645d94232c7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:10.804811 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c6cafa52-277b-4435-85f1-c645d94232c7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:10.805235 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c6cafa52-277b-4435-85f1-c645d94232c7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:10.894889 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-c6cafa52-277b-4435-85f1-c645d94232c7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:10.905373 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c6cafa52-277b-4435-85f1-c645d94232c7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1511 microversion: 2.1 time: 0.121256 Aug 31 00:36:10.905951 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 92/177] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:10 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1511 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:11.063508 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-34fa2b6a-901d-43d1-8564-aa18159ba9c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:11.064195 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-34fa2b6a-901d-43d1-8564-aa18159ba9c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:11.070762 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-34fa2b6a-901d-43d1-8564-aa18159ba9c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:11.071241 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-34fa2b6a-901d-43d1-8564-aa18159ba9c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:11.071665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-34fa2b6a-901d-43d1-8564-aa18159ba9c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:11.072382 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-34fa2b6a-901d-43d1-8564-aa18159ba9c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:11.072991 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-34fa2b6a-901d-43d1-8564-aa18159ba9c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:11.073474 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-34fa2b6a-901d-43d1-8564-aa18159ba9c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:11.231428 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-34fa2b6a-901d-43d1-8564-aa18159ba9c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:11.245657 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-34fa2b6a-901d-43d1-8564-aa18159ba9c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.185667 Aug 31 00:36:11.246731 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 86/178] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:11 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:11.935765 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-818e6b9f-29c5-4759-a132-3a53b0281700 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:11.937688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-818e6b9f-29c5-4759-a132-3a53b0281700 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:11.947179 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-818e6b9f-29c5-4759-a132-3a53b0281700 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:11.947950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-818e6b9f-29c5-4759-a132-3a53b0281700 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:11.948570 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-818e6b9f-29c5-4759-a132-3a53b0281700 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:11.949583 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-818e6b9f-29c5-4759-a132-3a53b0281700 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:11.950397 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-818e6b9f-29c5-4759-a132-3a53b0281700 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:11.951086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-818e6b9f-29c5-4759-a132-3a53b0281700 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:12.099936 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-818e6b9f-29c5-4759-a132-3a53b0281700 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:12.108514 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-818e6b9f-29c5-4759-a132-3a53b0281700 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1511 microversion: 2.1 time: 0.184737 Aug 31 00:36:12.109554 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 93/179] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:11 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1511 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:12.273038 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f5be88e7-d5f4-4f12-8818-81039beb8e6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:12.273038 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-f5be88e7-d5f4-4f12-8818-81039beb8e6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:12.277854 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f5be88e7-d5f4-4f12-8818-81039beb8e6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:12.278430 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f5be88e7-d5f4-4f12-8818-81039beb8e6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:12.278871 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f5be88e7-d5f4-4f12-8818-81039beb8e6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:12.279571 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f5be88e7-d5f4-4f12-8818-81039beb8e6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:12.280136 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f5be88e7-d5f4-4f12-8818-81039beb8e6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:12.280464 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f5be88e7-d5f4-4f12-8818-81039beb8e6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:12.526667 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f5be88e7-d5f4-4f12-8818-81039beb8e6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:12.539215 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f5be88e7-d5f4-4f12-8818-81039beb8e6c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.273460 Aug 31 00:36:12.541579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 87/180] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:12 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:13.132732 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-e30720c6-bab3-46ed-9489-7cae2adefbe7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:13.133481 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-e30720c6-bab3-46ed-9489-7cae2adefbe7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:13.142218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e30720c6-bab3-46ed-9489-7cae2adefbe7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:13.142782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e30720c6-bab3-46ed-9489-7cae2adefbe7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:13.143299 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e30720c6-bab3-46ed-9489-7cae2adefbe7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:13.144053 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e30720c6-bab3-46ed-9489-7cae2adefbe7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:13.146212 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e30720c6-bab3-46ed-9489-7cae2adefbe7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:13.146726 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e30720c6-bab3-46ed-9489-7cae2adefbe7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:13.233652 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-e30720c6-bab3-46ed-9489-7cae2adefbe7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:13.244717 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-e30720c6-bab3-46ed-9489-7cae2adefbe7 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1511 microversion: 2.1 time: 0.115659 Aug 31 00:36:13.245863 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 94/181] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:13 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1511 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:13.563042 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-3b264323-849c-4780-967a-d5ca3b5e4647 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:13.563782 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-3b264323-849c-4780-967a-d5ca3b5e4647 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:13.570450 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3b264323-849c-4780-967a-d5ca3b5e4647 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:13.570935 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3b264323-849c-4780-967a-d5ca3b5e4647 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:13.571366 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3b264323-849c-4780-967a-d5ca3b5e4647 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:13.572061 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3b264323-849c-4780-967a-d5ca3b5e4647 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:13.572560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3b264323-849c-4780-967a-d5ca3b5e4647 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:13.572992 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3b264323-849c-4780-967a-d5ca3b5e4647 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:13.724878 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-3b264323-849c-4780-967a-d5ca3b5e4647 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:13.735352 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-3b264323-849c-4780-967a-d5ca3b5e4647 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.175981 Aug 31 00:36:13.736514 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 88/182] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:13 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:14.266047 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-97015de0-faad-446f-8709-0cd58af414ca tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:14.266647 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-97015de0-faad-446f-8709-0cd58af414ca tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:14.277994 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-97015de0-faad-446f-8709-0cd58af414ca tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:14.278413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-97015de0-faad-446f-8709-0cd58af414ca tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:14.278915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-97015de0-faad-446f-8709-0cd58af414ca tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:14.279728 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-97015de0-faad-446f-8709-0cd58af414ca tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:14.280111 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-97015de0-faad-446f-8709-0cd58af414ca tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:14.280559 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-97015de0-faad-446f-8709-0cd58af414ca tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:14.325318 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-97015de0-faad-446f-8709-0cd58af414ca tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:14.326851 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-97015de0-faad-446f-8709-0cd58af414ca tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:14.327488 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-97015de0-faad-446f-8709-0cd58af414ca tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:14.328152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-97015de0-faad-446f-8709-0cd58af414ca tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lazy-loading 'fault' on Instance uuid 31dd6cf1-78b5-438d-95ce-aa6229958298 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:36:14.446086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-97015de0-faad-446f-8709-0cd58af414ca tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703b8e63fa4449dfb85de594a8d2e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0528602037241c98f36d12984aa26a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:14.458269 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-97015de0-faad-446f-8709-0cd58af414ca tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 200 len: 1350 microversion: 2.1 time: 0.195407 Aug 31 00:36:14.465916 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 95/183] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:14 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 1350 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:14.760809 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-898c4448-1208-4571-b5b9-bf648647f1b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:14.762072 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-898c4448-1208-4571-b5b9-bf648647f1b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:14.769296 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-898c4448-1208-4571-b5b9-bf648647f1b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:14.769985 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-898c4448-1208-4571-b5b9-bf648647f1b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:14.770459 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-898c4448-1208-4571-b5b9-bf648647f1b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:14.771178 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-898c4448-1208-4571-b5b9-bf648647f1b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:14.776829 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-898c4448-1208-4571-b5b9-bf648647f1b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:14.777526 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-898c4448-1208-4571-b5b9-bf648647f1b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:15.007654 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-898c4448-1208-4571-b5b9-bf648647f1b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:15.019196 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-898c4448-1208-4571-b5b9-bf648647f1b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.263821 Aug 31 00:36:15.021038 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 89/184] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:14 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:15.487619 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-03fef6d1-5c56-442b-bee9-9e7b478c9aff tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:15.488465 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-03fef6d1-5c56-442b-bee9-9e7b478c9aff tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:15.499457 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-03fef6d1-5c56-442b-bee9-9e7b478c9aff tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:15.503291 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-03fef6d1-5c56-442b-bee9-9e7b478c9aff tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:15.504360 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-03fef6d1-5c56-442b-bee9-9e7b478c9aff tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:15.506061 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-03fef6d1-5c56-442b-bee9-9e7b478c9aff tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:15.508953 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-03fef6d1-5c56-442b-bee9-9e7b478c9aff tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:15.510078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-03fef6d1-5c56-442b-bee9-9e7b478c9aff tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:15.548669 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-03fef6d1-5c56-442b-bee9-9e7b478c9aff tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] HTTP exception thrown: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-03fef6d1-5c56-442b-bee9-9e7b478c9aff tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Request method failure captured: Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 HTTP/1.1 Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqyw1nRkkbpa-d6C3aDUOsOW0df643qJjLaMsUHVEQILAFiv6dKF5yvKWXWQ3W50yhICP73H7xfqIgoD0JvfMkrPiqtsdNMWEJctFbfq8GA2qbZpNmWydDuoE0xTzHlASF_2WH1hmDx8T9jmrWoUikw2qUx5qI9Y-zaq2X5602Ohgrw Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: c0528602037241c98f36d12984aa26a9 Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-DeleteServersTestJSON-328888790 Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:36:15.554278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:36:15.555793 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c0528602037241c98f36d12984aa26a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c0528602037241c98f36d12984aa26a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c0528602037241c98f36d12984aa26a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c0528602037241c98f36d12984aa26a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:36:15.555793 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-DeleteServersTestJSON-328888790 Aug 31 00:36:15.555793 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: c0528602037241c98f36d12984aa26a9 Aug 31 00:36:15.555793 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-DeleteServersTestJSON-328888790 Aug 31 00:36:15.555793 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-DeleteServersTestJSON-328888790-project Aug 31 00:36:15.555793 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:36:15.555793 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:36:15.555793 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 703b8e63fa4449dfb85de594a8d2e5fe Aug 31 00:36:15.555793 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-DeleteServersTestJSON-328888790-project Aug 31 00:36:15.555793 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:36:15.555793 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:15.555793 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': '31dd6cf1-78b5-438d-95ce-aa6229958298'} Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:36:15.556590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:36:15.557686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:36:15.557686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:36:15.557686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:36:15.557686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:36:15.557686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:36:15.557686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:36:15.557686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:36:15.557686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:15.557686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:36:15.557686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:36:15.557686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:36:15.557686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:36:15.557686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:36:15.557686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:36:15.557686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:36:15.557686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:36:15.557686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:15.557686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:36:15.558640 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-03fef6d1-5c56-442b-bee9-9e7b478c9aff tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Returning 404 to user: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:36:15.558640 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-03fef6d1-5c56-442b-bee9-9e7b478c9aff tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 404 len: 111 microversion: 2.1 time: 0.079322 Aug 31 00:36:15.558640 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 96/185] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:15 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:36:15.694450 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-981edf3a-8a1b-4f08-b4cc-2d76cc71fdb2 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:15.696927 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-981edf3a-8a1b-4f08-b4cc-2d76cc71fdb2 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:15.703632 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-981edf3a-8a1b-4f08-b4cc-2d76cc71fdb2 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:15.704693 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-981edf3a-8a1b-4f08-b4cc-2d76cc71fdb2 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:15.705332 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-981edf3a-8a1b-4f08-b4cc-2d76cc71fdb2 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:15.706298 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-981edf3a-8a1b-4f08-b4cc-2d76cc71fdb2 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:15.707084 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-981edf3a-8a1b-4f08-b4cc-2d76cc71fdb2 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:15.719409 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-981edf3a-8a1b-4f08-b4cc-2d76cc71fdb2 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:15.723691 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-981edf3a-8a1b-4f08-b4cc-2d76cc71fdb2 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] HTTP exception thrown: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-981edf3a-8a1b-4f08-b4cc-2d76cc71fdb2 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Request method failure captured: Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298/os-volume_attachments HTTP/1.1 Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDqyw1nRkkbpa-d6C3aDUOsOW0df643qJjLaMsUHVEQILAFiv6dKF5yvKWXWQ3W50yhICP73H7xfqIgoD0JvfMkrPiqtsdNMWEJctFbfq8GA2qbZpNmWydDuoE0xTzHlASF_2WH1hmDx8T9jmrWoUikw2qUx5qI9Y-zaq2X5602Ohgrw Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: c0528602037241c98f36d12984aa26a9 Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-DeleteServersTestJSON-328888790 Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:36:15.730307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:36:15.732015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c0528602037241c98f36d12984aa26a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c0528602037241c98f36d12984aa26a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c0528602037241c98f36d12984aa26a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c0528602037241c98f36d12984aa26a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:36:15.732015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-DeleteServersTestJSON-328888790 Aug 31 00:36:15.732015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: c0528602037241c98f36d12984aa26a9 Aug 31 00:36:15.732015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-DeleteServersTestJSON-328888790 Aug 31 00:36:15.732015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-DeleteServersTestJSON-328888790-project Aug 31 00:36:15.732015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:36:15.732015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:36:15.732015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 703b8e63fa4449dfb85de594a8d2e5fe Aug 31 00:36:15.732015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-DeleteServersTestJSON-328888790-project Aug 31 00:36:15.732015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:36:15.732015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:15.732015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'server_id': '31dd6cf1-78b5-438d-95ce-aa6229958298'} Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:36:15.733376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:15.734705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:36:15.736088 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-981edf3a-8a1b-4f08-b4cc-2d76cc71fdb2 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Returning 404 to user: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:36:15.736582 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-981edf3a-8a1b-4f08-b4cc-2d76cc71fdb2 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044724 Aug 31 00:36:15.737270 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 90/186] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:36:15 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:36:16.045723 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-1eb834e6-e8fc-42c8-96dd-cc9d62b38de9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:16.046613 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-1eb834e6-e8fc-42c8-96dd-cc9d62b38de9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:16.059686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1eb834e6-e8fc-42c8-96dd-cc9d62b38de9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:16.061034 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1eb834e6-e8fc-42c8-96dd-cc9d62b38de9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:16.061911 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1eb834e6-e8fc-42c8-96dd-cc9d62b38de9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:16.069093 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1eb834e6-e8fc-42c8-96dd-cc9d62b38de9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:16.070039 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1eb834e6-e8fc-42c8-96dd-cc9d62b38de9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:16.071312 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1eb834e6-e8fc-42c8-96dd-cc9d62b38de9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:16.413196 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-1eb834e6-e8fc-42c8-96dd-cc9d62b38de9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:16.427403 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-1eb834e6-e8fc-42c8-96dd-cc9d62b38de9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.384579 Aug 31 00:36:16.430742 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 97/187] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:16 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:36:17.459538 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d01831f3-582f-4d47-9637-29cfe4ca1232 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:17.460141 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d01831f3-582f-4d47-9637-29cfe4ca1232 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:17.472532 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d01831f3-582f-4d47-9637-29cfe4ca1232 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:17.473176 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d01831f3-582f-4d47-9637-29cfe4ca1232 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:17.479633 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d01831f3-582f-4d47-9637-29cfe4ca1232 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:17.480673 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d01831f3-582f-4d47-9637-29cfe4ca1232 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:17.481157 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d01831f3-582f-4d47-9637-29cfe4ca1232 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:17.481591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d01831f3-582f-4d47-9637-29cfe4ca1232 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:17.712756 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d01831f3-582f-4d47-9637-29cfe4ca1232 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:17.722828 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d01831f3-582f-4d47-9637-29cfe4ca1232 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.268249 Aug 31 00:36:17.724161 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 91/188] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:17 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:18.631410 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6198a826-68ed-4dba-81b8-ea1bd78e1e74 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Action: 'create', calling method: .version_select at 0x7f551ebf2dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1773331990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+jlpiq37xb0W7FFUhkNVtbgMDNSjPvuJ3Sw56JYD96Cp99VYk6JgBWiFAxJ+8XDAmlrXRQv/G3U+P3E237Am+v4aXG46StkpP1Vi59wzeq4rVLve3XALv/yHt88VC1aA=="}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:36:18.655494 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-6198a826-68ed-4dba-81b8-ea1bd78e1e74 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Getting quotas for project ebe5283d88b44f8b824c7bbca56b3473. Resources: {'key_pairs'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:36:18.660112 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-6198a826-68ed-4dba-81b8-ea1bd78e1e74 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Getting quotas for user 022c4688d9ce4df9a99ae5fa84e1d871 and project ebe5283d88b44f8b824c7bbca56b3473. Resources: {'key_pairs'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:36:18.745527 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7d8c4d8c-58ec-4f02-8149-d5ac8947d553 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:18.746123 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7d8c4d8c-58ec-4f02-8149-d5ac8947d553 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:18.755935 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7d8c4d8c-58ec-4f02-8149-d5ac8947d553 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:18.756633 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7d8c4d8c-58ec-4f02-8149-d5ac8947d553 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:18.757017 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7d8c4d8c-58ec-4f02-8149-d5ac8947d553 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:18.757702 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7d8c4d8c-58ec-4f02-8149-d5ac8947d553 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:18.758148 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7d8c4d8c-58ec-4f02-8149-d5ac8947d553 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:18.758572 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7d8c4d8c-58ec-4f02-8149-d5ac8947d553 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:18.770484 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6198a826-68ed-4dba-81b8-ea1bd78e1e74 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.395643 Aug 31 00:36:18.777683 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 98/189] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 00:36:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:36:18.919445 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-7d8c4d8c-58ec-4f02-8149-d5ac8947d553 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:18.928935 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-7d8c4d8c-58ec-4f02-8149-d5ac8947d553 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.187176 Aug 31 00:36:18.932606 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 92/190] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:18 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:36:19.951503 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-971eb9d3-9d61-41cc-9818-fdb836472831 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:19.952115 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-971eb9d3-9d61-41cc-9818-fdb836472831 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:19.959561 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-971eb9d3-9d61-41cc-9818-fdb836472831 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:19.960168 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-971eb9d3-9d61-41cc-9818-fdb836472831 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:19.960643 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-971eb9d3-9d61-41cc-9818-fdb836472831 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:19.961337 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-971eb9d3-9d61-41cc-9818-fdb836472831 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:19.961789 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-971eb9d3-9d61-41cc-9818-fdb836472831 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:19.962201 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-971eb9d3-9d61-41cc-9818-fdb836472831 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:20.101920 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-971eb9d3-9d61-41cc-9818-fdb836472831 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:20.109761 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-971eb9d3-9d61-41cc-9818-fdb836472831 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.162464 Aug 31 00:36:20.110337 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 99/191] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:19 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:20.454198 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-5b4c4b97-e956-4310-8f2c-cee98dcb1d26 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:20.454770 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-5b4c4b97-e956-4310-8f2c-cee98dcb1d26 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:20.461071 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5b4c4b97-e956-4310-8f2c-cee98dcb1d26 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:20.463486 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5b4c4b97-e956-4310-8f2c-cee98dcb1d26 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:20.463486 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5b4c4b97-e956-4310-8f2c-cee98dcb1d26 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:20.463486 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5b4c4b97-e956-4310-8f2c-cee98dcb1d26 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:20.463486 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5b4c4b97-e956-4310-8f2c-cee98dcb1d26 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:20.463962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5b4c4b97-e956-4310-8f2c-cee98dcb1d26 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:20.476966 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-5b4c4b97-e956-4310-8f2c-cee98dcb1d26 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] HTTP exception thrown: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-5b4c4b97-e956-4310-8f2c-cee98dcb1d26 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Request method failure captured: Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: DELETE /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 HTTP/1.1 Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDqyw1nRkkbpa-d6C3aDUOsOW0df643qJjLaMsUHVEQILAFiv6dKF5yvKWXWQ3W50yhICP73H7xfqIgoD0JvfMkrPiqtsdNMWEJctFbfq8GA2qbZpNmWydDuoE0xTzHlASF_2WH1hmDx8T9jmrWoUikw2qUx5qI9Y-zaq2X5602Ohgrw Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: c0528602037241c98f36d12984aa26a9 Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-DeleteServersTestJSON-328888790 Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:36:20.479197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:36:20.480752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c0528602037241c98f36d12984aa26a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c0528602037241c98f36d12984aa26a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c0528602037241c98f36d12984aa26a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c0528602037241c98f36d12984aa26a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:36:20.480752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-DeleteServersTestJSON-328888790 Aug 31 00:36:20.480752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: c0528602037241c98f36d12984aa26a9 Aug 31 00:36:20.480752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-DeleteServersTestJSON-328888790 Aug 31 00:36:20.480752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-DeleteServersTestJSON-328888790-project Aug 31 00:36:20.480752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:36:20.480752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:36:20.480752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 703b8e63fa4449dfb85de594a8d2e5fe Aug 31 00:36:20.480752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-DeleteServersTestJSON-328888790-project Aug 31 00:36:20.480752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:36:20.480752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:20.480752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': '31dd6cf1-78b5-438d-95ce-aa6229958298'} Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:36:20.481662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:20.482862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:36:20.484220 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-5b4c4b97-e956-4310-8f2c-cee98dcb1d26 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Returning 404 to user: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:36:20.484220 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-5b4c4b97-e956-4310-8f2c-cee98dcb1d26 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "DELETE /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 404 len: 111 microversion: 2.1 time: 0.030305 Aug 31 00:36:20.484220 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 93/192] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:36:20 2022] DELETE /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:36:20.491550 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-58718b8d-cb8c-45d4-9e02-8a7537c34fc1 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:20.492186 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-58718b8d-cb8c-45d4-9e02-8a7537c34fc1 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] [instance: 31dd6cf1-78b5-438d-95ce-aa6229958298] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:20.504415 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-58718b8d-cb8c-45d4-9e02-8a7537c34fc1 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:20.504415 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-58718b8d-cb8c-45d4-9e02-8a7537c34fc1 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:20.504415 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-58718b8d-cb8c-45d4-9e02-8a7537c34fc1 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:20.504415 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-58718b8d-cb8c-45d4-9e02-8a7537c34fc1 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:20.505391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-58718b8d-cb8c-45d4-9e02-8a7537c34fc1 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:20.505391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-58718b8d-cb8c-45d4-9e02-8a7537c34fc1 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:20.517067 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-58718b8d-cb8c-45d4-9e02-8a7537c34fc1 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] HTTP exception thrown: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-58718b8d-cb8c-45d4-9e02-8a7537c34fc1 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Request method failure captured: Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 HTTP/1.1 Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqyw1nRkkbpa-d6C3aDUOsOW0df643qJjLaMsUHVEQILAFiv6dKF5yvKWXWQ3W50yhICP73H7xfqIgoD0JvfMkrPiqtsdNMWEJctFbfq8GA2qbZpNmWydDuoE0xTzHlASF_2WH1hmDx8T9jmrWoUikw2qUx5qI9Y-zaq2X5602Ohgrw Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: c0528602037241c98f36d12984aa26a9 Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-DeleteServersTestJSON-328888790 Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:36:20.518709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:36:20.519865 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c0528602037241c98f36d12984aa26a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c0528602037241c98f36d12984aa26a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c0528602037241c98f36d12984aa26a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c0528602037241c98f36d12984aa26a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:36:20.519865 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-DeleteServersTestJSON-328888790 Aug 31 00:36:20.519865 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: c0528602037241c98f36d12984aa26a9 Aug 31 00:36:20.519865 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-DeleteServersTestJSON-328888790 Aug 31 00:36:20.519865 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-DeleteServersTestJSON-328888790-project Aug 31 00:36:20.519865 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:36:20.519865 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:36:20.519865 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 703b8e63fa4449dfb85de594a8d2e5fe Aug 31 00:36:20.519865 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-DeleteServersTestJSON-328888790-project Aug 31 00:36:20.519865 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:36:20.519865 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:20.519865 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': '31dd6cf1-78b5-438d-95ce-aa6229958298'} Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:36:20.521078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:36:20.522103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:36:20.522103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:36:20.522103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:36:20.522103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:36:20.522103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:36:20.522103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:36:20.522103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:36:20.522103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:20.522103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:36:20.522103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:36:20.522103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:36:20.522103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:36:20.522103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:36:20.522103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:36:20.522103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:36:20.522103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:36:20.522103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. Aug 31 00:36:20.522103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:36:20.523282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-58718b8d-cb8c-45d4-9e02-8a7537c34fc1 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] Returning 404 to user: Instance 31dd6cf1-78b5-438d-95ce-aa6229958298 could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:36:20.523282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-58718b8d-cb8c-45d4-9e02-8a7537c34fc1 tempest-DeleteServersTestJSON-328888790 tempest-DeleteServersTestJSON-328888790-project] 10.222.0.65 "GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298" status: 404 len: 111 microversion: 2.1 time: 0.034668 Aug 31 00:36:20.523282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 100/193] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:20 2022] GET /compute/v2.1/servers/31dd6cf1-78b5-438d-95ce-aa6229958298 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:36:21.132276 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-4cc76111-436b-42e2-934d-0c4bf70745fd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:21.132928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-4cc76111-436b-42e2-934d-0c4bf70745fd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:21.139748 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4cc76111-436b-42e2-934d-0c4bf70745fd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:21.140247 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4cc76111-436b-42e2-934d-0c4bf70745fd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:21.140717 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4cc76111-436b-42e2-934d-0c4bf70745fd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:21.141461 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4cc76111-436b-42e2-934d-0c4bf70745fd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:21.142393 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4cc76111-436b-42e2-934d-0c4bf70745fd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:21.142919 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4cc76111-436b-42e2-934d-0c4bf70745fd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:21.447059 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4cc76111-436b-42e2-934d-0c4bf70745fd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:21.463280 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-4cc76111-436b-42e2-934d-0c4bf70745fd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.336114 Aug 31 00:36:21.464441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 94/194] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:21 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:22.486747 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-7819bd47-c2c5-4f37-bfde-d20a5d4cda76 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:22.487139 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-7819bd47-c2c5-4f37-bfde-d20a5d4cda76 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:22.495842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7819bd47-c2c5-4f37-bfde-d20a5d4cda76 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:22.498092 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7819bd47-c2c5-4f37-bfde-d20a5d4cda76 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:22.498092 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7819bd47-c2c5-4f37-bfde-d20a5d4cda76 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:22.498092 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7819bd47-c2c5-4f37-bfde-d20a5d4cda76 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:22.498535 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7819bd47-c2c5-4f37-bfde-d20a5d4cda76 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:22.499037 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7819bd47-c2c5-4f37-bfde-d20a5d4cda76 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:22.707266 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7819bd47-c2c5-4f37-bfde-d20a5d4cda76 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:22.716631 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-7819bd47-c2c5-4f37-bfde-d20a5d4cda76 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.234278 Aug 31 00:36:22.717676 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 101/195] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:22 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:23.741988 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9ddfe222-8842-4d8d-b1ce-176b19a36c8d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:23.743204 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9ddfe222-8842-4d8d-b1ce-176b19a36c8d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:23.752209 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9ddfe222-8842-4d8d-b1ce-176b19a36c8d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:23.753163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9ddfe222-8842-4d8d-b1ce-176b19a36c8d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:23.753803 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9ddfe222-8842-4d8d-b1ce-176b19a36c8d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:23.755521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9ddfe222-8842-4d8d-b1ce-176b19a36c8d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:23.756389 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9ddfe222-8842-4d8d-b1ce-176b19a36c8d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:23.757502 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9ddfe222-8842-4d8d-b1ce-176b19a36c8d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:24.279793 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-9ddfe222-8842-4d8d-b1ce-176b19a36c8d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:24.288790 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9ddfe222-8842-4d8d-b1ce-176b19a36c8d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.553078 Aug 31 00:36:24.289364 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 95/196] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:23 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:25.318919 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-fe59aead-b7ae-46ab-8dfc-fffc4208a801 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:25.320111 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-fe59aead-b7ae-46ab-8dfc-fffc4208a801 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:25.335643 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fe59aead-b7ae-46ab-8dfc-fffc4208a801 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:25.336545 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fe59aead-b7ae-46ab-8dfc-fffc4208a801 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:25.337722 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fe59aead-b7ae-46ab-8dfc-fffc4208a801 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:25.338664 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fe59aead-b7ae-46ab-8dfc-fffc4208a801 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:25.339443 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fe59aead-b7ae-46ab-8dfc-fffc4208a801 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:25.340064 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fe59aead-b7ae-46ab-8dfc-fffc4208a801 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:25.603418 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-fe59aead-b7ae-46ab-8dfc-fffc4208a801 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:25.630759 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-fe59aead-b7ae-46ab-8dfc-fffc4208a801 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.316452 Aug 31 00:36:25.632758 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 102/197] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:25 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:26.653641 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-38b99a68-4bac-4254-82f0-0a638f7d46b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:26.654412 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-38b99a68-4bac-4254-82f0-0a638f7d46b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:26.661994 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-38b99a68-4bac-4254-82f0-0a638f7d46b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:26.662590 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-38b99a68-4bac-4254-82f0-0a638f7d46b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:26.663105 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-38b99a68-4bac-4254-82f0-0a638f7d46b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:26.667981 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-38b99a68-4bac-4254-82f0-0a638f7d46b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:26.668978 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-38b99a68-4bac-4254-82f0-0a638f7d46b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:26.669463 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-38b99a68-4bac-4254-82f0-0a638f7d46b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:26.858277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-38b99a68-4bac-4254-82f0-0a638f7d46b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:26.875553 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-38b99a68-4bac-4254-82f0-0a638f7d46b8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.224222 Aug 31 00:36:26.876468 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 96/198] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:26 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:27.900147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0fb88e95-ae1d-4905-85a1-f00d4337b46e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:27.900856 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-0fb88e95-ae1d-4905-85a1-f00d4337b46e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:27.907094 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:27.909143 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0fb88e95-ae1d-4905-85a1-f00d4337b46e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:27.909693 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0fb88e95-ae1d-4905-85a1-f00d4337b46e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:27.910393 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0fb88e95-ae1d-4905-85a1-f00d4337b46e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:27.911451 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0fb88e95-ae1d-4905-85a1-f00d4337b46e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:27.912132 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0fb88e95-ae1d-4905-85a1-f00d4337b46e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:27.912783 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0fb88e95-ae1d-4905-85a1-f00d4337b46e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:27.934860 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:28.365101 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-0fb88e95-ae1d-4905-85a1-f00d4337b46e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:28.373025 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-0fb88e95-ae1d-4905-85a1-f00d4337b46e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.478640 Aug 31 00:36:28.373615 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 103/199] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:27 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:29.398657 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-3eb456f2-10af-4d7e-879d-aed96d985109 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:29.401762 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-3eb456f2-10af-4d7e-879d-aed96d985109 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:29.412502 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3eb456f2-10af-4d7e-879d-aed96d985109 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:29.413480 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3eb456f2-10af-4d7e-879d-aed96d985109 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:29.414090 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3eb456f2-10af-4d7e-879d-aed96d985109 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:29.414991 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3eb456f2-10af-4d7e-879d-aed96d985109 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:29.415514 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3eb456f2-10af-4d7e-879d-aed96d985109 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:29.415937 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3eb456f2-10af-4d7e-879d-aed96d985109 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:29.653748 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-3eb456f2-10af-4d7e-879d-aed96d985109 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:29.663780 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-3eb456f2-10af-4d7e-879d-aed96d985109 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1520 microversion: 2.1 time: 0.272870 Aug 31 00:36:29.665257 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 97/200] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:29 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:30.688183 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-91f9cdd2-1b4c-463d-b74e-8cffb35d435d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:30.688975 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-91f9cdd2-1b4c-463d-b74e-8cffb35d435d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:30.694772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=4 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:30.715861 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-91f9cdd2-1b4c-463d-b74e-8cffb35d435d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:30.717625 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-91f9cdd2-1b4c-463d-b74e-8cffb35d435d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:30.718419 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-91f9cdd2-1b4c-463d-b74e-8cffb35d435d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:30.725170 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-91f9cdd2-1b4c-463d-b74e-8cffb35d435d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:30.725170 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-91f9cdd2-1b4c-463d-b74e-8cffb35d435d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:30.725170 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-91f9cdd2-1b4c-463d-b74e-8cffb35d435d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:30.968830 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-91f9cdd2-1b4c-463d-b74e-8cffb35d435d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:31.002644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-91f9cdd2-1b4c-463d-b74e-8cffb35d435d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1500 microversion: 2.1 time: 0.319202 Aug 31 00:36:31.025690 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 104/201] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:30 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1500 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:31.038821 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-8d58c71e-82ec-4cf7-b68d-1dadff7fd1e2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:31.039688 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-8d58c71e-82ec-4cf7-b68d-1dadff7fd1e2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:31.048407 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8d58c71e-82ec-4cf7-b68d-1dadff7fd1e2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:31.049602 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8d58c71e-82ec-4cf7-b68d-1dadff7fd1e2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:31.052982 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8d58c71e-82ec-4cf7-b68d-1dadff7fd1e2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:31.055526 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8d58c71e-82ec-4cf7-b68d-1dadff7fd1e2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:31.058105 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8d58c71e-82ec-4cf7-b68d-1dadff7fd1e2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:31.063592 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8d58c71e-82ec-4cf7-b68d-1dadff7fd1e2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:31.386202 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-8d58c71e-82ec-4cf7-b68d-1dadff7fd1e2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:31.401724 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-8d58c71e-82ec-4cf7-b68d-1dadff7fd1e2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1515 microversion: 2.1 time: 0.366628 Aug 31 00:36:31.403166 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 98/202] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:31 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1515 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:36.825982 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-1ff5cb58-c914-4691-b95c-4bef0fbfdfc4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:36:36.829193 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-1ff5cb58-c914-4691-b95c-4bef0fbfdfc4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:36.843977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1ff5cb58-c914-4691-b95c-4bef0fbfdfc4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:36.848537 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1ff5cb58-c914-4691-b95c-4bef0fbfdfc4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:36.849465 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1ff5cb58-c914-4691-b95c-4bef0fbfdfc4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:36.872982 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1ff5cb58-c914-4691-b95c-4bef0fbfdfc4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:36.874467 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1ff5cb58-c914-4691-b95c-4bef0fbfdfc4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:36.875286 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1ff5cb58-c914-4691-b95c-4bef0fbfdfc4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:36.946940 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-1ff5cb58-c914-4691-b95c-4bef0fbfdfc4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lazy-loading 'flavor' on Instance uuid e71a61bc-1bd8-4191-96c6-7f7e2e4db485 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:36:37.292599 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-1ff5cb58-c914-4691-b95c-4bef0fbfdfc4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "POST /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485/action" status: 200 len: 32 microversion: 2.1 time: 0.471087 Aug 31 00:36:37.299158 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 105/203] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 00:36:36 2022] POST /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485/action => generated 32 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:36:37.307327 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7902deb8-5b43-4e50-878c-5753478acbde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:37.311460 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7902deb8-5b43-4e50-878c-5753478acbde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:37.314142 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=42 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:37.319689 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7902deb8-5b43-4e50-878c-5753478acbde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:37.320405 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7902deb8-5b43-4e50-878c-5753478acbde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:37.320857 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7902deb8-5b43-4e50-878c-5753478acbde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:37.321723 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7902deb8-5b43-4e50-878c-5753478acbde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:37.322165 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7902deb8-5b43-4e50-878c-5753478acbde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:37.322580 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7902deb8-5b43-4e50-878c-5753478acbde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:37.325777 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=97 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:37.886719 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-7902deb8-5b43-4e50-878c-5753478acbde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:37.897953 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-7902deb8-5b43-4e50-878c-5753478acbde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.597813 Aug 31 00:36:37.900699 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 99/204] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:37 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:38.922191 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-92a9f208-2fa7-48fc-b960-6e75f7b38839 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:38.923430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-92a9f208-2fa7-48fc-b960-6e75f7b38839 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:38.938001 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-92a9f208-2fa7-48fc-b960-6e75f7b38839 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:38.940184 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-92a9f208-2fa7-48fc-b960-6e75f7b38839 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:38.942168 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-92a9f208-2fa7-48fc-b960-6e75f7b38839 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:38.943424 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-92a9f208-2fa7-48fc-b960-6e75f7b38839 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:38.944461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-92a9f208-2fa7-48fc-b960-6e75f7b38839 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:38.945140 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-92a9f208-2fa7-48fc-b960-6e75f7b38839 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:39.120044 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-92a9f208-2fa7-48fc-b960-6e75f7b38839 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:39.127883 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-92a9f208-2fa7-48fc-b960-6e75f7b38839 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.210859 Aug 31 00:36:39.129125 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 106/205] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:38 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:39.243412 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-b622ce3e-af95-490f-8a85-2811b520230d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Action: 'create', calling method: .version_select at 0x7f551ec01a60>, body: {"keypair": {"name": "tempest-keypair-460130469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORkednk8gqAjSLKGCmoDuS4b9BvGnL/0diny4uJj/7XtU4iPq3A9zSElxk/WeBuCV3mr3Y+vwQTyu8YE4CyTHG/ZdOklxKQZF+zYJCP6gxz8VMPRVIF5+2pVt9+KyVr7A=="}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:36:39.263960 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-b622ce3e-af95-490f-8a85-2811b520230d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Getting quotas for project 5023455241594360bacff911a6641d7a. Resources: {'key_pairs'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:36:39.270434 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-b622ce3e-af95-490f-8a85-2811b520230d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Getting quotas for user ac2476465c4c4bd2b1cf81934b6e9a7d and project 5023455241594360bacff911a6641d7a. Resources: {'key_pairs'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:36:39.405998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-b622ce3e-af95-490f-8a85-2811b520230d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.303474 Aug 31 00:36:39.406903 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 100/206] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 00:36:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:36:40.152717 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c367741f-0422-49b9-bec4-436f1589d74a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:40.154174 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c367741f-0422-49b9-bec4-436f1589d74a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:40.170723 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c367741f-0422-49b9-bec4-436f1589d74a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:40.171691 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c367741f-0422-49b9-bec4-436f1589d74a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:40.172444 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c367741f-0422-49b9-bec4-436f1589d74a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:40.173387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c367741f-0422-49b9-bec4-436f1589d74a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:40.174075 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c367741f-0422-49b9-bec4-436f1589d74a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:40.174788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c367741f-0422-49b9-bec4-436f1589d74a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:40.391078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-c367741f-0422-49b9-bec4-436f1589d74a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:40.401349 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c367741f-0422-49b9-bec4-436f1589d74a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.254185 Aug 31 00:36:40.402516 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 107/207] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:40 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:41.446599 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-b24778ae-918d-4225-877a-404e8e7cd348 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:41.447227 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-b24778ae-918d-4225-877a-404e8e7cd348 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:41.462492 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b24778ae-918d-4225-877a-404e8e7cd348 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:41.463264 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b24778ae-918d-4225-877a-404e8e7cd348 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:41.463853 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b24778ae-918d-4225-877a-404e8e7cd348 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:41.464799 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b24778ae-918d-4225-877a-404e8e7cd348 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:41.465410 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b24778ae-918d-4225-877a-404e8e7cd348 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:41.465996 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b24778ae-918d-4225-877a-404e8e7cd348 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:41.801799 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b24778ae-918d-4225-877a-404e8e7cd348 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:41.814620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-b24778ae-918d-4225-877a-404e8e7cd348 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.388615 Aug 31 00:36:41.815288 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 101/208] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:41 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:42.844214 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-8dcc129e-794f-4996-ae7b-b9cd5cdf564a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:42.845572 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-8dcc129e-794f-4996-ae7b-b9cd5cdf564a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:42.852668 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8dcc129e-794f-4996-ae7b-b9cd5cdf564a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:42.853635 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8dcc129e-794f-4996-ae7b-b9cd5cdf564a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:42.854235 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8dcc129e-794f-4996-ae7b-b9cd5cdf564a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:42.855253 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8dcc129e-794f-4996-ae7b-b9cd5cdf564a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:42.855892 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8dcc129e-794f-4996-ae7b-b9cd5cdf564a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:42.856548 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8dcc129e-794f-4996-ae7b-b9cd5cdf564a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:42.997928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-140125c5-3c63-4a0b-8c65-df1d5383c4dd tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Action: 'create', calling method: .version_select at 0x7f551ecffdc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-879339634", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQAxLMIAMOBtopQ1Xaebm9bMy9joQXNmO8+CKqRyGA81B59WldYP4PwqC/VZJyfnRwWaDwN7ais5LC8zKaMed/T//Al+oMKrYJRSxf/P/5o5mVWyTnCmD6wM7Zycw8dVg=="}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:36:43.021126 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-140125c5-3c63-4a0b-8c65-df1d5383c4dd tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Getting quotas for project 28f0cda364854dfd9fde0249a751ecf4. Resources: {'key_pairs'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:36:43.027912 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-140125c5-3c63-4a0b-8c65-df1d5383c4dd tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Getting quotas for user c639977b5f6744b9939d1e5a9745cd03 and project 28f0cda364854dfd9fde0249a751ecf4. Resources: {'key_pairs'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:36:43.077185 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-8dcc129e-794f-4996-ae7b-b9cd5cdf564a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:43.086165 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-8dcc129e-794f-4996-ae7b-b9cd5cdf564a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.253894 Aug 31 00:36:43.086743 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 102/209] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:42 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:43.091751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-e3043aa8-c8e8-43a2-9885-0d6757ea0f0c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1056477396", "imageRef": "12947ed8-8ca9-442d-9224-509e79a198e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5ba44fa-fe70-448e-874e-97120592a817"}], "security_groups": [{"name": "tempest-securitygroup--75688633"}], "key_name": "tempest-keypair-460130469", "user_data": "}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:36:43.151147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-140125c5-3c63-4a0b-8c65-df1d5383c4dd tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.332315 Aug 31 00:36:43.151827 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 108/210] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 00:36:42 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:36:43.201063 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.network.neutron [None req-e3043aa8-c8e8-43a2-9885-0d6757ea0f0c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] validate_networks() for [('a5ba44fa-fe70-448e-874e-97120592a817', None, None, None, None, None)] {{(pid=128048) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:36:43.651684 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-e3043aa8-c8e8-43a2-9885-0d6757ea0f0c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Flavor limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:36:43.652101 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-e3043aa8-c8e8-43a2-9885-0d6757ea0f0c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Image limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:36:43.652863 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-e3043aa8-c8e8-43a2-9885-0d6757ea0f0c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Flavor pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:36:43.653076 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-e3043aa8-c8e8-43a2-9885-0d6757ea0f0c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Image pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:36:43.653491 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-e3043aa8-c8e8-43a2-9885-0d6757ea0f0c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:36:43.664825 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e3043aa8-c8e8-43a2-9885-0d6757ea0f0c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:43.665490 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e3043aa8-c8e8-43a2-9885-0d6757ea0f0c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:43.666072 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e3043aa8-c8e8-43a2-9885-0d6757ea0f0c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:43.667012 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e3043aa8-c8e8-43a2-9885-0d6757ea0f0c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:43.667628 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e3043aa8-c8e8-43a2-9885-0d6757ea0f0c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:43.668200 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e3043aa8-c8e8-43a2-9885-0d6757ea0f0c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:43.691931 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-e3043aa8-c8e8-43a2-9885-0d6757ea0f0c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Getting quotas for project 5023455241594360bacff911a6641d7a. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:36:43.697000 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-e3043aa8-c8e8-43a2-9885-0d6757ea0f0c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Getting quotas for user ac2476465c4c4bd2b1cf81934b6e9a7d and project 5023455241594360bacff911a6641d7a. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:36:43.714250 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-e3043aa8-c8e8-43a2-9885-0d6757ea0f0c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Going to run 1 instances... {{(pid=128048) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:36:43.717356 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-e3043aa8-c8e8-43a2-9885-0d6757ea0f0c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12947ed8-8ca9-442d-9224-509e79a198e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128048) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:36:43.818303 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-e3043aa8-c8e8-43a2-9885-0d6757ea0f0c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.730299 Aug 31 00:36:43.818950 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 103/211] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:36:43 2022] POST /compute/v2.1/servers => generated 400 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:36:43.830484 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-831c4b3c-2a46-474a-aacb-d49070c7eff7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:43.831339 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-831c4b3c-2a46-474a-aacb-d49070c7eff7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:44.096800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-831c4b3c-2a46-474a-aacb-d49070c7eff7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:44.107912 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-45161136-4535-4570-8848-c5348a8c2d9b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:44.108731 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-45161136-4535-4570-8848-c5348a8c2d9b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:44.120103 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-45161136-4535-4570-8848-c5348a8c2d9b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:44.127086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-831c4b3c-2a46-474a-aacb-d49070c7eff7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1237 microversion: 2.1 time: 0.297265 Aug 31 00:36:44.128045 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-45161136-4535-4570-8848-c5348a8c2d9b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:44.129256 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-45161136-4535-4570-8848-c5348a8c2d9b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:44.149326 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 109/212] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:43 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1237 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:44.156610 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-45161136-4535-4570-8848-c5348a8c2d9b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:44.157545 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-45161136-4535-4570-8848-c5348a8c2d9b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:44.158006 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-45161136-4535-4570-8848-c5348a8c2d9b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:44.723692 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-45161136-4535-4570-8848-c5348a8c2d9b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:44.742769 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-45161136-4535-4570-8848-c5348a8c2d9b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.639075 Aug 31 00:36:44.745724 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 104/213] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:44 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:36:45.155500 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8b8cce82-faa2-48c3-9b65-b6da5d10f78f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:45.156276 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8b8cce82-faa2-48c3-9b65-b6da5d10f78f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:45.215747 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8b8cce82-faa2-48c3-9b65-b6da5d10f78f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:45.227775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8b8cce82-faa2-48c3-9b65-b6da5d10f78f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1237 microversion: 2.1 time: 0.076523 Aug 31 00:36:45.228601 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 110/214] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:45 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1237 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:45.773140 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-e5eca4c4-06e2-4a4c-82ad-3d85d1929b19 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:45.773915 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-e5eca4c4-06e2-4a4c-82ad-3d85d1929b19 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:45.786559 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e5eca4c4-06e2-4a4c-82ad-3d85d1929b19 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:45.787861 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e5eca4c4-06e2-4a4c-82ad-3d85d1929b19 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:45.789591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e5eca4c4-06e2-4a4c-82ad-3d85d1929b19 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:45.791154 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e5eca4c4-06e2-4a4c-82ad-3d85d1929b19 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:45.792028 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e5eca4c4-06e2-4a4c-82ad-3d85d1929b19 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:45.792818 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e5eca4c4-06e2-4a4c-82ad-3d85d1929b19 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:46.031660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-e5eca4c4-06e2-4a4c-82ad-3d85d1929b19 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:46.048218 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-e5eca4c4-06e2-4a4c-82ad-3d85d1929b19 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.279282 Aug 31 00:36:46.063571 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 105/215] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:45 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:46.265633 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-377ddad9-ee82-4a7f-bbc1-95c0d1a32392 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:46.266552 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-377ddad9-ee82-4a7f-bbc1-95c0d1a32392 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:46.272925 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-377ddad9-ee82-4a7f-bbc1-95c0d1a32392 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:46.273462 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-377ddad9-ee82-4a7f-bbc1-95c0d1a32392 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:46.273925 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-377ddad9-ee82-4a7f-bbc1-95c0d1a32392 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:46.274829 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-377ddad9-ee82-4a7f-bbc1-95c0d1a32392 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:46.275434 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-377ddad9-ee82-4a7f-bbc1-95c0d1a32392 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:46.276032 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-377ddad9-ee82-4a7f-bbc1-95c0d1a32392 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:46.361448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-377ddad9-ee82-4a7f-bbc1-95c0d1a32392 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:46.366951 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-377ddad9-ee82-4a7f-bbc1-95c0d1a32392 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1241 microversion: 2.1 time: 0.105501 Aug 31 00:36:46.367531 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 111/216] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:46 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1241 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:47.088200 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-4840e3d1-af3f-46a9-8b7b-83f7191ae6b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:47.088724 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-4840e3d1-af3f-46a9-8b7b-83f7191ae6b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:47.097543 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4840e3d1-af3f-46a9-8b7b-83f7191ae6b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:47.098031 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4840e3d1-af3f-46a9-8b7b-83f7191ae6b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:47.098498 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4840e3d1-af3f-46a9-8b7b-83f7191ae6b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:47.099197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4840e3d1-af3f-46a9-8b7b-83f7191ae6b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:47.099647 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4840e3d1-af3f-46a9-8b7b-83f7191ae6b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:47.100081 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4840e3d1-af3f-46a9-8b7b-83f7191ae6b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:47.336034 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4840e3d1-af3f-46a9-8b7b-83f7191ae6b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:47.349902 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-4840e3d1-af3f-46a9-8b7b-83f7191ae6b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.266211 Aug 31 00:36:47.351283 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 106/217] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:47 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:47.387746 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a94a1d42-1431-4630-a672-034f7b1665dd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:47.388368 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a94a1d42-1431-4630-a672-034f7b1665dd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:47.395370 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a94a1d42-1431-4630-a672-034f7b1665dd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:47.397524 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a94a1d42-1431-4630-a672-034f7b1665dd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:47.397524 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a94a1d42-1431-4630-a672-034f7b1665dd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:47.397524 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a94a1d42-1431-4630-a672-034f7b1665dd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:47.397955 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a94a1d42-1431-4630-a672-034f7b1665dd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:47.398151 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a94a1d42-1431-4630-a672-034f7b1665dd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:47.509974 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a94a1d42-1431-4630-a672-034f7b1665dd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:47.517666 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a94a1d42-1431-4630-a672-034f7b1665dd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1241 microversion: 2.1 time: 0.133840 Aug 31 00:36:47.524870 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 112/218] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:47 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1241 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:48.379992 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-34354cfb-6233-4089-818f-ccc430b2caad tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:48.380741 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-34354cfb-6233-4089-818f-ccc430b2caad tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:48.393664 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-34354cfb-6233-4089-818f-ccc430b2caad tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:48.395308 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-34354cfb-6233-4089-818f-ccc430b2caad tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:48.397754 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-34354cfb-6233-4089-818f-ccc430b2caad tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:48.398963 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-34354cfb-6233-4089-818f-ccc430b2caad tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:48.401203 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-34354cfb-6233-4089-818f-ccc430b2caad tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:48.406583 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-34354cfb-6233-4089-818f-ccc430b2caad tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:48.541341 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d42c66c3-20fe-4eca-b6b0-e133e7e31377 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:48.542750 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d42c66c3-20fe-4eca-b6b0-e133e7e31377 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:48.550208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d42c66c3-20fe-4eca-b6b0-e133e7e31377 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:48.550733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d42c66c3-20fe-4eca-b6b0-e133e7e31377 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:48.551173 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d42c66c3-20fe-4eca-b6b0-e133e7e31377 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:48.551876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d42c66c3-20fe-4eca-b6b0-e133e7e31377 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:48.552427 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d42c66c3-20fe-4eca-b6b0-e133e7e31377 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:48.552852 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d42c66c3-20fe-4eca-b6b0-e133e7e31377 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:48.584602 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-34354cfb-6233-4089-818f-ccc430b2caad tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:48.595645 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-34354cfb-6233-4089-818f-ccc430b2caad tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.223037 Aug 31 00:36:48.596697 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 107/219] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:48 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:48.631695 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d42c66c3-20fe-4eca-b6b0-e133e7e31377 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:48.640452 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d42c66c3-20fe-4eca-b6b0-e133e7e31377 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1289 microversion: 2.1 time: 0.104940 Aug 31 00:36:48.641021 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 113/220] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:48 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1289 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:36:49.619829 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-31b303d0-2bb3-44d4-beb1-f3ed1aebbc7c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:49.620475 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-31b303d0-2bb3-44d4-beb1-f3ed1aebbc7c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:49.626974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-31b303d0-2bb3-44d4-beb1-f3ed1aebbc7c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:49.627543 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-31b303d0-2bb3-44d4-beb1-f3ed1aebbc7c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:49.627969 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-31b303d0-2bb3-44d4-beb1-f3ed1aebbc7c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:49.628932 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-31b303d0-2bb3-44d4-beb1-f3ed1aebbc7c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:49.629384 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-31b303d0-2bb3-44d4-beb1-f3ed1aebbc7c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:49.629799 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-31b303d0-2bb3-44d4-beb1-f3ed1aebbc7c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:49.667611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-711ed0ee-5893-481e-9647-ce1c5e833031 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:49.669490 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-711ed0ee-5893-481e-9647-ce1c5e833031 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:49.676569 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-711ed0ee-5893-481e-9647-ce1c5e833031 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:49.677065 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-711ed0ee-5893-481e-9647-ce1c5e833031 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:49.677508 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-711ed0ee-5893-481e-9647-ce1c5e833031 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:49.678985 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-711ed0ee-5893-481e-9647-ce1c5e833031 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:49.678985 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-711ed0ee-5893-481e-9647-ce1c5e833031 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:49.679281 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-711ed0ee-5893-481e-9647-ce1c5e833031 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:49.757959 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-711ed0ee-5893-481e-9647-ce1c5e833031 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:49.767296 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-711ed0ee-5893-481e-9647-ce1c5e833031 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1295 microversion: 2.1 time: 0.107839 Aug 31 00:36:49.780918 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 114/221] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:49 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1295 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:36:49.930787 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-31b303d0-2bb3-44d4-beb1-f3ed1aebbc7c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:49.939709 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-31b303d0-2bb3-44d4-beb1-f3ed1aebbc7c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.323703 Aug 31 00:36:49.940279 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 108/222] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:49 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:50.790491 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-5275dc01-a033-4ecd-8c52-24bb97d6df3d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:50.791763 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-5275dc01-a033-4ecd-8c52-24bb97d6df3d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:50.798762 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5275dc01-a033-4ecd-8c52-24bb97d6df3d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:50.799240 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5275dc01-a033-4ecd-8c52-24bb97d6df3d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:50.799668 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5275dc01-a033-4ecd-8c52-24bb97d6df3d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:50.800444 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5275dc01-a033-4ecd-8c52-24bb97d6df3d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:50.800890 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5275dc01-a033-4ecd-8c52-24bb97d6df3d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:50.801475 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5275dc01-a033-4ecd-8c52-24bb97d6df3d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:50.950321 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-5275dc01-a033-4ecd-8c52-24bb97d6df3d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:50.966182 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-64acad4e-95c0-491b-a4e9-af2a40efde94 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:50.967536 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-64acad4e-95c0-491b-a4e9-af2a40efde94 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:50.969424 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-5275dc01-a033-4ecd-8c52-24bb97d6df3d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1361 microversion: 2.1 time: 0.183115 Aug 31 00:36:50.974502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 115/223] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:50 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:50.987204 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-64acad4e-95c0-491b-a4e9-af2a40efde94 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:50.990610 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-64acad4e-95c0-491b-a4e9-af2a40efde94 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:50.991322 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-64acad4e-95c0-491b-a4e9-af2a40efde94 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:50.992481 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-64acad4e-95c0-491b-a4e9-af2a40efde94 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:50.993024 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-64acad4e-95c0-491b-a4e9-af2a40efde94 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:50.993524 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-64acad4e-95c0-491b-a4e9-af2a40efde94 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:51.262985 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-64acad4e-95c0-491b-a4e9-af2a40efde94 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:51.273245 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-64acad4e-95c0-491b-a4e9-af2a40efde94 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.313285 Aug 31 00:36:51.286296 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 109/224] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:50 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:51.866379 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-93ff54be-ed4b-4d15-b93a-36f3914fb9d0 req-9256c5e8-67d5-4e3d-bf67-2068ffb7668a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07dc2669-6605-431c-93a5-884348c09ebf", "tag": "53407fde-ade2-453c-975e-4fafb7f9e4d5"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:36:51.881944 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-93ff54be-ed4b-4d15-b93a-36f3914fb9d0 req-9256c5e8-67d5-4e3d-bf67-2068ffb7668a service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:51.883227 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-93ff54be-ed4b-4d15-b93a-36f3914fb9d0 req-9256c5e8-67d5-4e3d-bf67-2068ffb7668a service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:51.883660 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-93ff54be-ed4b-4d15-b93a-36f3914fb9d0 req-9256c5e8-67d5-4e3d-bf67-2068ffb7668a service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:51.898547 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-93ff54be-ed4b-4d15-b93a-36f3914fb9d0 req-9256c5e8-67d5-4e3d-bf67-2068ffb7668a service nova] Creating event network-changed:53407fde-ade2-453c-975e-4fafb7f9e4d5 for instance 07dc2669-6605-431c-93a5-884348c09ebf on hv-cinder-85221 Aug 31 00:36:51.908084 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-93ff54be-ed4b-4d15-b93a-36f3914fb9d0 req-9256c5e8-67d5-4e3d-bf67-2068ffb7668a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045681 Aug 31 00:36:51.908749 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 116/225] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:36:51.999472 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7f829002-dd2a-4779-b0ed-629ae5091caa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:52.000661 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7f829002-dd2a-4779-b0ed-629ae5091caa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:52.010126 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f829002-dd2a-4779-b0ed-629ae5091caa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:52.010943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f829002-dd2a-4779-b0ed-629ae5091caa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:52.011536 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f829002-dd2a-4779-b0ed-629ae5091caa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:52.012655 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f829002-dd2a-4779-b0ed-629ae5091caa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:52.013663 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f829002-dd2a-4779-b0ed-629ae5091caa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:52.014232 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f829002-dd2a-4779-b0ed-629ae5091caa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:52.299189 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0656cdc7-0f5f-4158-8302-fb43264b6a0f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:52.300020 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-0656cdc7-0f5f-4158-8302-fb43264b6a0f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:52.309949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0656cdc7-0f5f-4158-8302-fb43264b6a0f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:52.309949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0656cdc7-0f5f-4158-8302-fb43264b6a0f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:52.311082 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0656cdc7-0f5f-4158-8302-fb43264b6a0f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:52.311932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0656cdc7-0f5f-4158-8302-fb43264b6a0f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:52.312522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0656cdc7-0f5f-4158-8302-fb43264b6a0f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:52.313706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0656cdc7-0f5f-4158-8302-fb43264b6a0f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:52.355025 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-7f829002-dd2a-4779-b0ed-629ae5091caa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:52.363387 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-7f829002-dd2a-4779-b0ed-629ae5091caa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1361 microversion: 2.1 time: 0.368424 Aug 31 00:36:52.363955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 110/226] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:51 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1361 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:52.488492 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-0656cdc7-0f5f-4158-8302-fb43264b6a0f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:52.499683 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-0656cdc7-0f5f-4158-8302-fb43264b6a0f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.205845 Aug 31 00:36:52.500722 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 117/227] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:52 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:36:53.385322 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-75811504-81cb-4406-ab8c-8f6fb769e191 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:53.386527 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-75811504-81cb-4406-ab8c-8f6fb769e191 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:53.393013 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-75811504-81cb-4406-ab8c-8f6fb769e191 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:53.393497 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-75811504-81cb-4406-ab8c-8f6fb769e191 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:53.394617 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-75811504-81cb-4406-ab8c-8f6fb769e191 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:53.395453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-75811504-81cb-4406-ab8c-8f6fb769e191 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:53.395902 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-75811504-81cb-4406-ab8c-8f6fb769e191 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:53.396317 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-75811504-81cb-4406-ab8c-8f6fb769e191 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:53.522530 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-62f2de9e-f8e2-4c63-b0e0-5fa4c9fd7fc1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:53.523495 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-62f2de9e-f8e2-4c63-b0e0-5fa4c9fd7fc1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:53.532436 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-62f2de9e-f8e2-4c63-b0e0-5fa4c9fd7fc1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:53.532436 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-62f2de9e-f8e2-4c63-b0e0-5fa4c9fd7fc1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:53.532436 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-62f2de9e-f8e2-4c63-b0e0-5fa4c9fd7fc1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:53.532855 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-62f2de9e-f8e2-4c63-b0e0-5fa4c9fd7fc1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:53.533416 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-62f2de9e-f8e2-4c63-b0e0-5fa4c9fd7fc1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:53.533848 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-62f2de9e-f8e2-4c63-b0e0-5fa4c9fd7fc1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:53.546630 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-75811504-81cb-4406-ab8c-8f6fb769e191 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:53.558550 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-75811504-81cb-4406-ab8c-8f6fb769e191 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1361 microversion: 2.1 time: 0.178840 Aug 31 00:36:53.561400 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 111/228] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:53 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:53.683958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-62f2de9e-f8e2-4c63-b0e0-5fa4c9fd7fc1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:53.691532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-62f2de9e-f8e2-4c63-b0e0-5fa4c9fd7fc1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.172701 Aug 31 00:36:53.692132 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 118/229] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:53 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:36:53.848463 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-08faf3d5-c99b-44a5-81e2-425663fd631e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1200727809", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1773331990", "security_groups": [{"name": "tempest-secgroup-smoke-1046497227"}], "block_device_mapping_v2": [{"uuid": "e809d00f-5c75-4627-b573-208034333980", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5c79103f-c4fa-4069-a202-b12e6c4f8e87"}]}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:36:53.860657 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:53.861665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=10 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:53.990167 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.network.neutron [None req-08faf3d5-c99b-44a5-81e2-425663fd631e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] validate_networks() for [('5c79103f-c4fa-4069-a202-b12e6c4f8e87', None, None, None, None, None)] {{(pid=128048) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:36:54.582495 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-22e2c54a-29ee-4e38-8a94-caed712e097e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:54.583081 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-22e2c54a-29ee-4e38-8a94-caed712e097e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:54.590500 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-22e2c54a-29ee-4e38-8a94-caed712e097e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:54.591009 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-22e2c54a-29ee-4e38-8a94-caed712e097e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:54.591459 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-22e2c54a-29ee-4e38-8a94-caed712e097e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:54.592415 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-22e2c54a-29ee-4e38-8a94-caed712e097e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:54.592894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-22e2c54a-29ee-4e38-8a94-caed712e097e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:54.593322 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-22e2c54a-29ee-4e38-8a94-caed712e097e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:54.771245 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-22e2c54a-29ee-4e38-8a94-caed712e097e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:54.783382 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-22e2c54a-29ee-4e38-8a94-caed712e097e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1361 microversion: 2.1 time: 0.206532 Aug 31 00:36:54.783963 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 119/230] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:54 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1361 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:54.787037 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-08faf3d5-c99b-44a5-81e2-425663fd631e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Flavor limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:36:54.787593 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-08faf3d5-c99b-44a5-81e2-425663fd631e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Image limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:36:54.788214 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-08faf3d5-c99b-44a5-81e2-425663fd631e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Flavor pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:36:54.788793 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-08faf3d5-c99b-44a5-81e2-425663fd631e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Image pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:36:54.789996 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-08faf3d5-c99b-44a5-81e2-425663fd631e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:36:54.790589 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-da2d5e84-c0d7-45ea-8974-4279dcae866f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:54.791352 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-da2d5e84-c0d7-45ea-8974-4279dcae866f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:54.799342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-da2d5e84-c0d7-45ea-8974-4279dcae866f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:54.799913 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-da2d5e84-c0d7-45ea-8974-4279dcae866f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:54.800582 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-da2d5e84-c0d7-45ea-8974-4279dcae866f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:54.801442 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-da2d5e84-c0d7-45ea-8974-4279dcae866f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:54.802057 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-da2d5e84-c0d7-45ea-8974-4279dcae866f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:54.802682 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-da2d5e84-c0d7-45ea-8974-4279dcae866f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:54.806100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-08faf3d5-c99b-44a5-81e2-425663fd631e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:54.808906 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-08faf3d5-c99b-44a5-81e2-425663fd631e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:54.809689 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-08faf3d5-c99b-44a5-81e2-425663fd631e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:54.810614 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-08faf3d5-c99b-44a5-81e2-425663fd631e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:54.811240 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-08faf3d5-c99b-44a5-81e2-425663fd631e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:54.811761 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-08faf3d5-c99b-44a5-81e2-425663fd631e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:54.835253 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-08faf3d5-c99b-44a5-81e2-425663fd631e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Getting quotas for project ebe5283d88b44f8b824c7bbca56b3473. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:36:54.839904 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-08faf3d5-c99b-44a5-81e2-425663fd631e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Getting quotas for user 022c4688d9ce4df9a99ae5fa84e1d871 and project ebe5283d88b44f8b824c7bbca56b3473. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:36:54.930205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-08faf3d5-c99b-44a5-81e2-425663fd631e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Going to run 1 instances... {{(pid=128048) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:36:54.932248 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-08faf3d5-c99b-44a5-81e2-425663fd631e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e809d00f-5c75-4627-b573-208034333980',volume_size=None,volume_type=None)] {{(pid=128048) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:36:55.002373 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-da2d5e84-c0d7-45ea-8974-4279dcae866f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:55.011515 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-da2d5e84-c0d7-45ea-8974-4279dcae866f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.225534 Aug 31 00:36:55.012514 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 120/231] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:54 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:55.421633 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-08faf3d5-c99b-44a5-81e2-425663fd631e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.577068 Aug 31 00:36:55.422286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 112/232] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:36:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:36:55.438549 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-9f6f2bd9-d61e-493f-a629-e6cf59949fcb tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:55.439948 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-9f6f2bd9-d61e-493f-a629-e6cf59949fcb tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:55.443428 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=8 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:55.501393 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-9f6f2bd9-d61e-493f-a629-e6cf59949fcb tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:55.508732 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-9f6f2bd9-d61e-493f-a629-e6cf59949fcb tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1095 microversion: 2.1 time: 0.074220 Aug 31 00:36:55.509535 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 121/233] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:55 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:55.809545 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-e04456f1-1fbd-4552-af53-4f8fb1a4b604 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:55.810452 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-e04456f1-1fbd-4552-af53-4f8fb1a4b604 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:55.819907 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e04456f1-1fbd-4552-af53-4f8fb1a4b604 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:55.820944 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e04456f1-1fbd-4552-af53-4f8fb1a4b604 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:55.822140 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e04456f1-1fbd-4552-af53-4f8fb1a4b604 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:55.822492 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e04456f1-1fbd-4552-af53-4f8fb1a4b604 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:55.826795 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e04456f1-1fbd-4552-af53-4f8fb1a4b604 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:55.827057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e04456f1-1fbd-4552-af53-4f8fb1a4b604 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:56.042700 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-172c2d27-93e8-43ff-897e-07ebb8f3e4c2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:56.043333 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-172c2d27-93e8-43ff-897e-07ebb8f3e4c2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:56.051414 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-e04456f1-1fbd-4552-af53-4f8fb1a4b604 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:56.051950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-172c2d27-93e8-43ff-897e-07ebb8f3e4c2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:56.052578 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-172c2d27-93e8-43ff-897e-07ebb8f3e4c2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:56.053021 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-172c2d27-93e8-43ff-897e-07ebb8f3e4c2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:56.054061 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-172c2d27-93e8-43ff-897e-07ebb8f3e4c2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:56.054600 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-172c2d27-93e8-43ff-897e-07ebb8f3e4c2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:56.055611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-172c2d27-93e8-43ff-897e-07ebb8f3e4c2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:56.073062 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-e04456f1-1fbd-4552-af53-4f8fb1a4b604 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1361 microversion: 2.1 time: 0.269971 Aug 31 00:36:56.073820 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 113/234] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:55 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1361 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:56.231398 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-172c2d27-93e8-43ff-897e-07ebb8f3e4c2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:56.234775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:56.239979 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-172c2d27-93e8-43ff-897e-07ebb8f3e4c2 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.208569 Aug 31 00:36:56.240650 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 122/235] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:56 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:56.531024 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a289ddea-5437-49d7-856d-99981440caa7 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:56.531626 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-a289ddea-5437-49d7-856d-99981440caa7 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:56.592515 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-a289ddea-5437-49d7-856d-99981440caa7 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:56.598103 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a289ddea-5437-49d7-856d-99981440caa7 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1095 microversion: 2.1 time: 0.070959 Aug 31 00:36:56.598941 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 114/236] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:56 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:57.098778 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8504c112-2149-441a-b1ee-afc2bacea450 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:57.099590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8504c112-2149-441a-b1ee-afc2bacea450 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:57.108468 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8504c112-2149-441a-b1ee-afc2bacea450 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:57.109360 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8504c112-2149-441a-b1ee-afc2bacea450 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:57.109940 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8504c112-2149-441a-b1ee-afc2bacea450 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:57.110804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8504c112-2149-441a-b1ee-afc2bacea450 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:57.111250 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8504c112-2149-441a-b1ee-afc2bacea450 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:57.111663 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8504c112-2149-441a-b1ee-afc2bacea450 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:57.264622 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-5029f0fc-3f48-4832-ba93-5296ffee814d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:57.265379 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-5029f0fc-3f48-4832-ba93-5296ffee814d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:57.265830 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8504c112-2149-441a-b1ee-afc2bacea450 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:57.273761 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5029f0fc-3f48-4832-ba93-5296ffee814d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:57.274255 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5029f0fc-3f48-4832-ba93-5296ffee814d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:57.274686 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5029f0fc-3f48-4832-ba93-5296ffee814d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:57.275435 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5029f0fc-3f48-4832-ba93-5296ffee814d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:57.275959 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5029f0fc-3f48-4832-ba93-5296ffee814d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:57.276309 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5029f0fc-3f48-4832-ba93-5296ffee814d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:57.283216 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8504c112-2149-441a-b1ee-afc2bacea450 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1361 microversion: 2.1 time: 0.191513 Aug 31 00:36:57.283835 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 123/237] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:57 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:57.428629 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-5029f0fc-3f48-4832-ba93-5296ffee814d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:57.454451 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-5029f0fc-3f48-4832-ba93-5296ffee814d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.189128 Aug 31 00:36:57.454451 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 115/238] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:57 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:36:57.619738 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-e785a384-4ca2-45cc-b620-cd592e1f5909 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:57.620368 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-e785a384-4ca2-45cc-b620-cd592e1f5909 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:57.626583 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e785a384-4ca2-45cc-b620-cd592e1f5909 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:57.627072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e785a384-4ca2-45cc-b620-cd592e1f5909 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:57.627504 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e785a384-4ca2-45cc-b620-cd592e1f5909 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:57.628798 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e785a384-4ca2-45cc-b620-cd592e1f5909 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:57.629258 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e785a384-4ca2-45cc-b620-cd592e1f5909 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:57.629683 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e785a384-4ca2-45cc-b620-cd592e1f5909 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:57.710180 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-e785a384-4ca2-45cc-b620-cd592e1f5909 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:57.720648 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-e785a384-4ca2-45cc-b620-cd592e1f5909 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1145 microversion: 2.1 time: 0.105211 Aug 31 00:36:57.734347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 124/239] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:57 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1145 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:58.306271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-4fa18459-5888-449b-86bd-f79b417b0c93 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:58.306990 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-4fa18459-5888-449b-86bd-f79b417b0c93 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:58.313065 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4fa18459-5888-449b-86bd-f79b417b0c93 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:58.313546 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4fa18459-5888-449b-86bd-f79b417b0c93 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:58.313971 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4fa18459-5888-449b-86bd-f79b417b0c93 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:58.314655 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4fa18459-5888-449b-86bd-f79b417b0c93 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:58.315105 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4fa18459-5888-449b-86bd-f79b417b0c93 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:58.315524 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4fa18459-5888-449b-86bd-f79b417b0c93 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:58.470165 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4fa18459-5888-449b-86bd-f79b417b0c93 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:58.472945 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-4fa18459-5888-449b-86bd-f79b417b0c93 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1361 microversion: 2.1 time: 0.170028 Aug 31 00:36:58.474144 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 116/240] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:58 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:58.479963 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f0166a37-7b4c-4c18-849a-c1fa05a0e2c9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:58.482198 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f0166a37-7b4c-4c18-849a-c1fa05a0e2c9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:58.489572 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f0166a37-7b4c-4c18-849a-c1fa05a0e2c9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:58.490423 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f0166a37-7b4c-4c18-849a-c1fa05a0e2c9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:58.491023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f0166a37-7b4c-4c18-849a-c1fa05a0e2c9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:58.492119 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f0166a37-7b4c-4c18-849a-c1fa05a0e2c9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:58.493748 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f0166a37-7b4c-4c18-849a-c1fa05a0e2c9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:58.497271 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f0166a37-7b4c-4c18-849a-c1fa05a0e2c9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:58.675103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f0166a37-7b4c-4c18-849a-c1fa05a0e2c9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:58.689390 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f0166a37-7b4c-4c18-849a-c1fa05a0e2c9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.215803 Aug 31 00:36:58.690196 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 125/241] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:58 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:36:58.742515 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7a50c7f3-f3da-4d6f-8669-0cd8527fac9d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:58.743371 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7a50c7f3-f3da-4d6f-8669-0cd8527fac9d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:58.749517 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a50c7f3-f3da-4d6f-8669-0cd8527fac9d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:58.750001 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a50c7f3-f3da-4d6f-8669-0cd8527fac9d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:58.750439 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a50c7f3-f3da-4d6f-8669-0cd8527fac9d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:58.751145 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a50c7f3-f3da-4d6f-8669-0cd8527fac9d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:58.751662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a50c7f3-f3da-4d6f-8669-0cd8527fac9d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:58.752256 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a50c7f3-f3da-4d6f-8669-0cd8527fac9d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:58.837758 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-7a50c7f3-f3da-4d6f-8669-0cd8527fac9d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:58.846095 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-7a50c7f3-f3da-4d6f-8669-0cd8527fac9d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1137 microversion: 2.1 time: 0.107502 Aug 31 00:36:58.846886 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 117/242] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:58 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1137 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:59.497029 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6f1b5750-6125-4942-ae17-3333e7ff73d1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:59.497805 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6f1b5750-6125-4942-ae17-3333e7ff73d1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:59.509479 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f1b5750-6125-4942-ae17-3333e7ff73d1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:59.509479 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f1b5750-6125-4942-ae17-3333e7ff73d1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:59.509479 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f1b5750-6125-4942-ae17-3333e7ff73d1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:59.509479 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f1b5750-6125-4942-ae17-3333e7ff73d1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:59.509960 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f1b5750-6125-4942-ae17-3333e7ff73d1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:59.509960 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f1b5750-6125-4942-ae17-3333e7ff73d1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:59.667477 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6f1b5750-6125-4942-ae17-3333e7ff73d1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:59.677846 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6f1b5750-6125-4942-ae17-3333e7ff73d1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1361 microversion: 2.1 time: 0.185102 Aug 31 00:36:59.678551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 126/243] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:59 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:59.713175 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-1ee9bf9d-cef6-40b4-9fba-acfa698eb79f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:59.713831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-1ee9bf9d-cef6-40b4-9fba-acfa698eb79f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:59.721601 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1ee9bf9d-cef6-40b4-9fba-acfa698eb79f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:59.722156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1ee9bf9d-cef6-40b4-9fba-acfa698eb79f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:59.722637 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1ee9bf9d-cef6-40b4-9fba-acfa698eb79f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:59.723294 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1ee9bf9d-cef6-40b4-9fba-acfa698eb79f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:59.723750 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1ee9bf9d-cef6-40b4-9fba-acfa698eb79f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:59.724165 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1ee9bf9d-cef6-40b4-9fba-acfa698eb79f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:59.867921 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ec45054e-6e82-42b1-9033-0433aa0bff69 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:36:59.868574 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ec45054e-6e82-42b1-9033-0433aa0bff69 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:36:59.876113 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec45054e-6e82-42b1-9033-0433aa0bff69 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:59.876844 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec45054e-6e82-42b1-9033-0433aa0bff69 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:59.877445 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec45054e-6e82-42b1-9033-0433aa0bff69 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:59.878142 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec45054e-6e82-42b1-9033-0433aa0bff69 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:36:59.879359 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec45054e-6e82-42b1-9033-0433aa0bff69 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:36:59.879943 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec45054e-6e82-42b1-9033-0433aa0bff69 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:36:59.896066 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-1ee9bf9d-cef6-40b4-9fba-acfa698eb79f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:59.906838 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-1ee9bf9d-cef6-40b4-9fba-acfa698eb79f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.197530 Aug 31 00:36:59.908022 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 118/244] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:59 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:36:59.951216 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ec45054e-6e82-42b1-9033-0433aa0bff69 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:36:59.960495 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ec45054e-6e82-42b1-9033-0433aa0bff69 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1193 microversion: 2.1 time: 0.096267 Aug 31 00:36:59.961597 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 127/245] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:36:59 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1193 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:00.017716 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-fc96874c-a605-401d-a02f-2e5a2d005593 req-5536e425-bdf3-4bfd-97da-3608d496b59f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07dc2669-6605-431c-93a5-884348c09ebf", "name": "network-vif-plugged", "status": "completed", "tag": "53407fde-ade2-453c-975e-4fafb7f9e4d5"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:00.030270 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-fc96874c-a605-401d-a02f-2e5a2d005593 req-5536e425-bdf3-4bfd-97da-3608d496b59f service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:00.030810 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-fc96874c-a605-401d-a02f-2e5a2d005593 req-5536e425-bdf3-4bfd-97da-3608d496b59f service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:00.031266 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-fc96874c-a605-401d-a02f-2e5a2d005593 req-5536e425-bdf3-4bfd-97da-3608d496b59f service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:00.036157 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=100 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:00.043837 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-fc96874c-a605-401d-a02f-2e5a2d005593 req-5536e425-bdf3-4bfd-97da-3608d496b59f service nova] Creating event network-vif-plugged:53407fde-ade2-453c-975e-4fafb7f9e4d5 for instance 07dc2669-6605-431c-93a5-884348c09ebf on hv-cinder-85221 Aug 31 00:37:00.049244 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-fc96874c-a605-401d-a02f-2e5a2d005593 req-5536e425-bdf3-4bfd-97da-3608d496b59f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036539 Aug 31 00:37:00.050290 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 119/246] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:37:00.699187 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a6cef5ef-e1e1-4158-8d97-0b19d9aa5800 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:00.699798 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a6cef5ef-e1e1-4158-8d97-0b19d9aa5800 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:00.706799 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6cef5ef-e1e1-4158-8d97-0b19d9aa5800 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:00.707381 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6cef5ef-e1e1-4158-8d97-0b19d9aa5800 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:00.707839 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6cef5ef-e1e1-4158-8d97-0b19d9aa5800 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:00.708567 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6cef5ef-e1e1-4158-8d97-0b19d9aa5800 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:00.709098 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6cef5ef-e1e1-4158-8d97-0b19d9aa5800 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:00.709550 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6cef5ef-e1e1-4158-8d97-0b19d9aa5800 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:00.856838 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a6cef5ef-e1e1-4158-8d97-0b19d9aa5800 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:00.864975 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a6cef5ef-e1e1-4158-8d97-0b19d9aa5800 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1361 microversion: 2.1 time: 0.169825 Aug 31 00:37:00.865531 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 128/247] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:00 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:00.932788 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-86481c85-1f26-444b-bc74-45e8da039f17 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:00.933510 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-86481c85-1f26-444b-bc74-45e8da039f17 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:00.939743 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-86481c85-1f26-444b-bc74-45e8da039f17 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:00.940156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-86481c85-1f26-444b-bc74-45e8da039f17 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:00.940617 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-86481c85-1f26-444b-bc74-45e8da039f17 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:00.941756 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-86481c85-1f26-444b-bc74-45e8da039f17 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:00.942267 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-86481c85-1f26-444b-bc74-45e8da039f17 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:00.942691 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-86481c85-1f26-444b-bc74-45e8da039f17 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:00.982706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ab3680c0-c1dc-473a-bbd0-938f71907f98 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:00.983707 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ab3680c0-c1dc-473a-bbd0-938f71907f98 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:00.987505 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:00.993785 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ab3680c0-c1dc-473a-bbd0-938f71907f98 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:00.994379 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ab3680c0-c1dc-473a-bbd0-938f71907f98 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:00.995209 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ab3680c0-c1dc-473a-bbd0-938f71907f98 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:00.995674 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ab3680c0-c1dc-473a-bbd0-938f71907f98 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:00.996157 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ab3680c0-c1dc-473a-bbd0-938f71907f98 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:00.996675 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ab3680c0-c1dc-473a-bbd0-938f71907f98 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:01.083180 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ab3680c0-c1dc-473a-bbd0-938f71907f98 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:01.106030 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ab3680c0-c1dc-473a-bbd0-938f71907f98 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1193 microversion: 2.1 time: 0.127173 Aug 31 00:37:01.110966 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 129/248] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:00 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1193 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:01.140077 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-86481c85-1f26-444b-bc74-45e8da039f17 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:01.148436 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-86481c85-1f26-444b-bc74-45e8da039f17 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.220364 Aug 31 00:37:01.149013 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 120/249] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:00 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:01.887592 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-272cd997-a40d-4dbd-b759-322ff2bd4b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:01.888196 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-272cd997-a40d-4dbd-b759-322ff2bd4b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:01.894945 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-272cd997-a40d-4dbd-b759-322ff2bd4b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:01.895473 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-272cd997-a40d-4dbd-b759-322ff2bd4b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:01.895905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-272cd997-a40d-4dbd-b759-322ff2bd4b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:01.896616 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-272cd997-a40d-4dbd-b759-322ff2bd4b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:01.897321 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-272cd997-a40d-4dbd-b759-322ff2bd4b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:01.897745 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-272cd997-a40d-4dbd-b759-322ff2bd4b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:02.040103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-272cd997-a40d-4dbd-b759-322ff2bd4b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:02.047838 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-272cd997-a40d-4dbd-b759-322ff2bd4b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1361 microversion: 2.1 time: 0.165610 Aug 31 00:37:02.048419 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 130/250] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:01 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:02.136142 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-bc1e5669-8915-4350-890e-26267d089f35 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:02.136802 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-bc1e5669-8915-4350-890e-26267d089f35 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:02.143159 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bc1e5669-8915-4350-890e-26267d089f35 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:02.144042 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bc1e5669-8915-4350-890e-26267d089f35 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:02.144746 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bc1e5669-8915-4350-890e-26267d089f35 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:02.145647 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bc1e5669-8915-4350-890e-26267d089f35 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:02.146305 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bc1e5669-8915-4350-890e-26267d089f35 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:02.146737 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bc1e5669-8915-4350-890e-26267d089f35 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:02.172815 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-fa2feff8-ff37-4596-b2aa-8ab85c4af885 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:02.174354 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-fa2feff8-ff37-4596-b2aa-8ab85c4af885 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:02.186784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fa2feff8-ff37-4596-b2aa-8ab85c4af885 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:02.187388 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fa2feff8-ff37-4596-b2aa-8ab85c4af885 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:02.187896 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fa2feff8-ff37-4596-b2aa-8ab85c4af885 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:02.188708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fa2feff8-ff37-4596-b2aa-8ab85c4af885 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:02.189462 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fa2feff8-ff37-4596-b2aa-8ab85c4af885 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:02.191552 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fa2feff8-ff37-4596-b2aa-8ab85c4af885 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:02.236402 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-bc1e5669-8915-4350-890e-26267d089f35 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:02.240811 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-bc1e5669-8915-4350-890e-26267d089f35 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1201 microversion: 2.1 time: 0.108659 Aug 31 00:37:02.241569 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 121/251] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:02 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1201 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:02.348902 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-fa2feff8-ff37-4596-b2aa-8ab85c4af885 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:02.356566 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-fa2feff8-ff37-4596-b2aa-8ab85c4af885 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1501 microversion: 2.1 time: 0.189276 Aug 31 00:37:02.359258 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 131/252] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:02 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1501 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:02.378680 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-6c980b3a-9af7-4f16-8aca-dc3aa09f1c4d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee593ca7-543c-46de-b315-de4d1e059339"}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:02.381089 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-6c980b3a-9af7-4f16-8aca-dc3aa09f1c4d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:02.387610 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6c980b3a-9af7-4f16-8aca-dc3aa09f1c4d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:02.388485 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6c980b3a-9af7-4f16-8aca-dc3aa09f1c4d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:02.388918 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6c980b3a-9af7-4f16-8aca-dc3aa09f1c4d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:02.389670 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6c980b3a-9af7-4f16-8aca-dc3aa09f1c4d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:02.390131 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6c980b3a-9af7-4f16-8aca-dc3aa09f1c4d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:02.390545 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6c980b3a-9af7-4f16-8aca-dc3aa09f1c4d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:02.416130 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-6c980b3a-9af7-4f16-8aca-dc3aa09f1c4d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] HTTP exception thrown: Cannot 'attach_volume' instance e71a61bc-1bd8-4191-96c6-7f7e2e4db485 while it is in vm_state rescued Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-6c980b3a-9af7-4f16-8aca-dc3aa09f1c4d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Request method failure captured: Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: POST /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485/os-volume_attachments HTTP/1.1 Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 74 Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDqyzEg2Mk_Qrf-4ucl5mTksNAq4yJwZyFBzvEgaG-5wDv2_jHH3xLzlf6obMgJH9KOGrXwUBwxa_Key6OaUOrEfJ-OUrg1I_ZHusiecer0qLWJfeK6Wzpvtw2fZKiIczmma4oKpwrpEcygSzKn_2orgSwt38-qdaeq_LONkjXnfIEKU Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: d8aa6e0e8e6b492f8e74eea0e830c0bc Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1041420977 Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:37:02.418057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:37:02.424277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:37:02.424277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1041420977 Aug 31 00:37:02.424277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: d8aa6e0e8e6b492f8e74eea0e830c0bc Aug 31 00:37:02.424277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1041420977 Aug 31 00:37:02.424277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-ServerRescueNegativeTestJSON-1041420977-project Aug 31 00:37:02.424277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:37:02.424277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:37:02.424277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 77d23c99308c414f939761b07d329e03 Aug 31 00:37:02.424277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1041420977-project Aug 31 00:37:02.424277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Aug 31 00:37:02.424277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {"volumeAttachment": {"volumeId": "ee593ca7-543c-46de-b315-de4d1e059339"}} Aug 31 00:37:02.424277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:37:02.425041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Cannot 'attach_volume' instance e71a61bc-1bd8-4191-96c6-7f7e2e4db485 while it is in vm_state rescued Aug 31 00:37:02.425041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'server_id': 'e71a61bc-1bd8-4191-96c6-7f7e2e4db485', 'body': {'volumeAttachment': {'volumeId': 'ee593ca7-543c-46de-b315-de4d1e059339'}}} Aug 31 00:37:02.425041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:37:02.425041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:02.425041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 00:37:02.425041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 00:37:02.425041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:37:02.425041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:37:02.425041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 00:37:02.425041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 00:37:02.425041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e71a61bc-1bd8-4191-96c6-7f7e2e4db485 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 00:37:02.425041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:37:02.425041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:02.425041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:37:02.425041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:02.425041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:37:02.425041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:37:02.425041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:37:02.425041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:37:02.426284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:37:02.426284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:37:02.426284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:37:02.426284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:37:02.426284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:37:02.426284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:37:02.426284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:37:02.426284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:37:02.426284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 00:37:02.426284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 00:37:02.426284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 00:37:02.426284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 00:37:02.426284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e71a61bc-1bd8-4191-96c6-7f7e2e4db485 while it is in vm_state rescued Aug 31 00:37:02.426284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:37:02.426284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:37:02.426284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:37:02.426284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:37:02.426284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:37:02.426284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:37:02.427439 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:37:02.427439 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:37:02.427439 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e71a61bc-1bd8-4191-96c6-7f7e2e4db485 while it is in vm_state rescued Aug 31 00:37:02.427439 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:37:02.427439 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-6c980b3a-9af7-4f16-8aca-dc3aa09f1c4d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Returning 409 to user: Cannot 'attach_volume' instance e71a61bc-1bd8-4191-96c6-7f7e2e4db485 while it is in vm_state rescued {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:37:02.427439 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-6c980b3a-9af7-4f16-8aca-dc3aa09f1c4d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "POST /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045117 Aug 31 00:37:02.427439 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 122/253] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 00:37:02 2022] POST /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 00:37:02.433209 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c8cfc80e-12ee-41b4-a606-ddc9a29242d4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:02.439027 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c8cfc80e-12ee-41b4-a606-ddc9a29242d4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:02.447851 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c8cfc80e-12ee-41b4-a606-ddc9a29242d4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:02.448290 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c8cfc80e-12ee-41b4-a606-ddc9a29242d4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:02.448896 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c8cfc80e-12ee-41b4-a606-ddc9a29242d4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:02.449707 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c8cfc80e-12ee-41b4-a606-ddc9a29242d4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:02.450171 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c8cfc80e-12ee-41b4-a606-ddc9a29242d4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:02.450602 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c8cfc80e-12ee-41b4-a606-ddc9a29242d4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:02.621835 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c8cfc80e-12ee-41b4-a606-ddc9a29242d4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "POST /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485/action" status: 202 len: 0 microversion: 2.1 time: 0.193524 Aug 31 00:37:02.622451 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 132/254] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 00:37:02 2022] POST /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:37:02.631332 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-dde3d32b-bcac-47d4-8563-37cd5164531b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:02.631938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-dde3d32b-bcac-47d4-8563-37cd5164531b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:02.638607 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-dde3d32b-bcac-47d4-8563-37cd5164531b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:02.639088 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-dde3d32b-bcac-47d4-8563-37cd5164531b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:02.639519 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-dde3d32b-bcac-47d4-8563-37cd5164531b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:02.640207 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-dde3d32b-bcac-47d4-8563-37cd5164531b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:02.640683 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-dde3d32b-bcac-47d4-8563-37cd5164531b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:02.641104 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-dde3d32b-bcac-47d4-8563-37cd5164531b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:02.898314 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-dde3d32b-bcac-47d4-8563-37cd5164531b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:02.910569 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-dde3d32b-bcac-47d4-8563-37cd5164531b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1509 microversion: 2.1 time: 0.283626 Aug 31 00:37:02.924362 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 123/255] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:02 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1509 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:03.070421 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d8f55895-48e5-4a20-95a0-3801733feff6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:03.071023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d8f55895-48e5-4a20-95a0-3801733feff6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:03.077423 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8f55895-48e5-4a20-95a0-3801733feff6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:03.078104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8f55895-48e5-4a20-95a0-3801733feff6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:03.083580 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8f55895-48e5-4a20-95a0-3801733feff6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:03.083580 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8f55895-48e5-4a20-95a0-3801733feff6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:03.083580 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8f55895-48e5-4a20-95a0-3801733feff6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:03.083580 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8f55895-48e5-4a20-95a0-3801733feff6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:03.232683 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d8f55895-48e5-4a20-95a0-3801733feff6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:03.241869 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d8f55895-48e5-4a20-95a0-3801733feff6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1361 microversion: 2.1 time: 0.177255 Aug 31 00:37:03.242630 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 133/256] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:03 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:03.263003 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d234fa9b-77fa-41fb-8715-f36230fb753f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:03.263613 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d234fa9b-77fa-41fb-8715-f36230fb753f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:03.270345 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d234fa9b-77fa-41fb-8715-f36230fb753f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:03.270987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d234fa9b-77fa-41fb-8715-f36230fb753f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:03.271594 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d234fa9b-77fa-41fb-8715-f36230fb753f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:03.272612 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d234fa9b-77fa-41fb-8715-f36230fb753f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:03.273255 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d234fa9b-77fa-41fb-8715-f36230fb753f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:03.273683 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d234fa9b-77fa-41fb-8715-f36230fb753f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:03.348695 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d234fa9b-77fa-41fb-8715-f36230fb753f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:03.356583 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d234fa9b-77fa-41fb-8715-f36230fb753f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1211 microversion: 2.1 time: 0.097365 Aug 31 00:37:03.357150 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 124/257] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:03 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:03.934650 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8e109a25-1275-4656-8d6d-4992b385422a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:03.935263 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8e109a25-1275-4656-8d6d-4992b385422a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:03.942725 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e109a25-1275-4656-8d6d-4992b385422a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:03.943220 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e109a25-1275-4656-8d6d-4992b385422a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:03.943662 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e109a25-1275-4656-8d6d-4992b385422a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:03.947495 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e109a25-1275-4656-8d6d-4992b385422a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:03.949134 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e109a25-1275-4656-8d6d-4992b385422a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:03.950010 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e109a25-1275-4656-8d6d-4992b385422a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:04.108994 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8e109a25-1275-4656-8d6d-4992b385422a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:04.118027 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8e109a25-1275-4656-8d6d-4992b385422a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1509 microversion: 2.1 time: 0.188552 Aug 31 00:37:04.120691 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 134/258] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:03 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:04.263995 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-8498f204-21f8-4948-b76f-884d640da66c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:04.264639 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-8498f204-21f8-4948-b76f-884d640da66c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:04.286838 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8498f204-21f8-4948-b76f-884d640da66c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:04.288437 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8498f204-21f8-4948-b76f-884d640da66c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:04.289110 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8498f204-21f8-4948-b76f-884d640da66c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:04.290298 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8498f204-21f8-4948-b76f-884d640da66c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:04.291273 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8498f204-21f8-4948-b76f-884d640da66c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:04.291918 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8498f204-21f8-4948-b76f-884d640da66c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:04.379862 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-24a50307-6492-4957-b494-e5ba31b8d28a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:04.381194 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-24a50307-6492-4957-b494-e5ba31b8d28a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:04.392862 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-24a50307-6492-4957-b494-e5ba31b8d28a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:04.393708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-24a50307-6492-4957-b494-e5ba31b8d28a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:04.394811 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-24a50307-6492-4957-b494-e5ba31b8d28a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:04.395559 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-24a50307-6492-4957-b494-e5ba31b8d28a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:04.396015 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-24a50307-6492-4957-b494-e5ba31b8d28a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:04.396650 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-24a50307-6492-4957-b494-e5ba31b8d28a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:04.588229 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-24a50307-6492-4957-b494-e5ba31b8d28a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:04.599791 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-24a50307-6492-4957-b494-e5ba31b8d28a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1279 microversion: 2.1 time: 0.224374 Aug 31 00:37:04.600401 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 135/259] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:04 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1279 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:04.820048 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:04.855363 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-8498f204-21f8-4948-b76f-884d640da66c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:04.864030 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-8498f204-21f8-4948-b76f-884d640da66c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1547 microversion: 2.1 time: 0.604557 Aug 31 00:37:04.864633 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 125/260] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:04 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1547 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:04.886606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f9538628-7377-49e6-895f-092245fcbc5d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:04.891763 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f9538628-7377-49e6-895f-092245fcbc5d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:04.893417 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9538628-7377-49e6-895f-092245fcbc5d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:04.893965 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9538628-7377-49e6-895f-092245fcbc5d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:04.894583 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9538628-7377-49e6-895f-092245fcbc5d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:04.895529 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9538628-7377-49e6-895f-092245fcbc5d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:04.895970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9538628-7377-49e6-895f-092245fcbc5d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:04.896423 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9538628-7377-49e6-895f-092245fcbc5d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:05.003984 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f9538628-7377-49e6-895f-092245fcbc5d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120874 Aug 31 00:37:05.005051 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 136/261] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 31 00:37:04 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:37:05.140279 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-3844efd6-4168-4607-8564-7227491322ef tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:05.140942 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-3844efd6-4168-4607-8564-7227491322ef tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:05.150590 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3844efd6-4168-4607-8564-7227491322ef tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:05.150590 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3844efd6-4168-4607-8564-7227491322ef tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:05.151033 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3844efd6-4168-4607-8564-7227491322ef tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:05.155274 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3844efd6-4168-4607-8564-7227491322ef tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:05.155274 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3844efd6-4168-4607-8564-7227491322ef tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:05.155274 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3844efd6-4168-4607-8564-7227491322ef tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:05.345993 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-4a44e5f3-e286-496f-800c-840827caf217 req-4e88595c-cfbe-45c8-bb67-87aa8bff39b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c", "tag": "a10d4df1-cb0a-416e-86a7-7179c9f9aac0"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:05.356626 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-4a44e5f3-e286-496f-800c-840827caf217 req-4e88595c-cfbe-45c8-bb67-87aa8bff39b3 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:05.357100 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-4a44e5f3-e286-496f-800c-840827caf217 req-4e88595c-cfbe-45c8-bb67-87aa8bff39b3 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:05.357519 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-4a44e5f3-e286-496f-800c-840827caf217 req-4e88595c-cfbe-45c8-bb67-87aa8bff39b3 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:05.369850 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-4a44e5f3-e286-496f-800c-840827caf217 req-4e88595c-cfbe-45c8-bb67-87aa8bff39b3 service nova] Creating event network-changed:a10d4df1-cb0a-416e-86a7-7179c9f9aac0 for instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c on hv-cinder-85221 Aug 31 00:37:05.377602 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-3844efd6-4168-4607-8564-7227491322ef tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:05.383405 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-4a44e5f3-e286-496f-800c-840827caf217 req-4e88595c-cfbe-45c8-bb67-87aa8bff39b3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038361 Aug 31 00:37:05.383405 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 137/262] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:37:05.391395 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-3844efd6-4168-4607-8564-7227491322ef tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1509 microversion: 2.1 time: 0.255838 Aug 31 00:37:05.392240 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 126/263] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:05 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:05.621451 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-11b65838-7cb5-4d72-aa27-0509403fd165 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:05.622256 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-11b65838-7cb5-4d72-aa27-0509403fd165 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:05.629292 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-11b65838-7cb5-4d72-aa27-0509403fd165 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:05.629957 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-11b65838-7cb5-4d72-aa27-0509403fd165 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:05.630389 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-11b65838-7cb5-4d72-aa27-0509403fd165 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:05.631096 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-11b65838-7cb5-4d72-aa27-0509403fd165 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:05.631558 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-11b65838-7cb5-4d72-aa27-0509403fd165 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:05.631981 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-11b65838-7cb5-4d72-aa27-0509403fd165 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:05.879098 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-11b65838-7cb5-4d72-aa27-0509403fd165 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:05.887414 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-11b65838-7cb5-4d72-aa27-0509403fd165 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1279 microversion: 2.1 time: 0.270377 Aug 31 00:37:05.888012 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 138/264] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:05 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1279 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:06.415381 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-8ddb970f-cd4c-464d-af0f-e8c8bc796a42 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:06.425140 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-8ddb970f-cd4c-464d-af0f-e8c8bc796a42 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:06.427910 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:06.432608 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ddb970f-cd4c-464d-af0f-e8c8bc796a42 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:06.433087 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ddb970f-cd4c-464d-af0f-e8c8bc796a42 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:06.433722 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ddb970f-cd4c-464d-af0f-e8c8bc796a42 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:06.434587 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ddb970f-cd4c-464d-af0f-e8c8bc796a42 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:06.435194 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ddb970f-cd4c-464d-af0f-e8c8bc796a42 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:06.435607 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ddb970f-cd4c-464d-af0f-e8c8bc796a42 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:06.552137 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-d9d26dad-ee8e-4c55-b705-bc176cc0ce91 req-8d120625-ba24-4d8a-a3b1-3bfecd2be8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07dc2669-6605-431c-93a5-884348c09ebf", "tag": "53407fde-ade2-453c-975e-4fafb7f9e4d5"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:06.557263 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=2 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:06.569390 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-d9d26dad-ee8e-4c55-b705-bc176cc0ce91 req-8d120625-ba24-4d8a-a3b1-3bfecd2be8c8 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:06.570192 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-d9d26dad-ee8e-4c55-b705-bc176cc0ce91 req-8d120625-ba24-4d8a-a3b1-3bfecd2be8c8 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:06.570843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-d9d26dad-ee8e-4c55-b705-bc176cc0ce91 req-8d120625-ba24-4d8a-a3b1-3bfecd2be8c8 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:06.587151 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-d9d26dad-ee8e-4c55-b705-bc176cc0ce91 req-8d120625-ba24-4d8a-a3b1-3bfecd2be8c8 service nova] Creating event network-changed:53407fde-ade2-453c-975e-4fafb7f9e4d5 for instance 07dc2669-6605-431c-93a5-884348c09ebf on hv-cinder-85221 Aug 31 00:37:06.594176 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-d9d26dad-ee8e-4c55-b705-bc176cc0ce91 req-8d120625-ba24-4d8a-a3b1-3bfecd2be8c8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045240 Aug 31 00:37:06.595555 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 139/265] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:37:06.598103 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=8 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:06.614620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-8ddb970f-cd4c-464d-af0f-e8c8bc796a42 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:06.623043 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-8ddb970f-cd4c-464d-af0f-e8c8bc796a42 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1509 microversion: 2.1 time: 0.211445 Aug 31 00:37:06.637232 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 127/266] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:06 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1509 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:06.918417 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-db785e39-e303-4dcc-b68e-f0c7ac95668e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:06.922921 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-db785e39-e303-4dcc-b68e-f0c7ac95668e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:06.933260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-db785e39-e303-4dcc-b68e-f0c7ac95668e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:06.934058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-db785e39-e303-4dcc-b68e-f0c7ac95668e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:06.934694 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-db785e39-e303-4dcc-b68e-f0c7ac95668e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:06.935660 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-db785e39-e303-4dcc-b68e-f0c7ac95668e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:06.936553 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-db785e39-e303-4dcc-b68e-f0c7ac95668e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:06.938169 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-db785e39-e303-4dcc-b68e-f0c7ac95668e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:06.945192 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:07.136776 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-db785e39-e303-4dcc-b68e-f0c7ac95668e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:07.149435 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-db785e39-e303-4dcc-b68e-f0c7ac95668e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1279 microversion: 2.1 time: 0.240024 Aug 31 00:37:07.153248 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-20911161-e8cd-4937-a6ce-50d021c27d6f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:07.154225 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-20911161-e8cd-4937-a6ce-50d021c27d6f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:07.160967 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 140/267] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:06 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1279 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:07.163576 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-20911161-e8cd-4937-a6ce-50d021c27d6f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:07.164082 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-20911161-e8cd-4937-a6ce-50d021c27d6f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:07.164552 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-20911161-e8cd-4937-a6ce-50d021c27d6f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:07.165251 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-20911161-e8cd-4937-a6ce-50d021c27d6f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:07.165697 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-20911161-e8cd-4937-a6ce-50d021c27d6f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:07.166115 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-20911161-e8cd-4937-a6ce-50d021c27d6f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:07.201532 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-20911161-e8cd-4937-a6ce-50d021c27d6f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/ips" status: 200 len: 152 microversion: 2.20 time: 0.053188 Aug 31 00:37:07.208611 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 128/268] 10.222.0.65 () {60 vars in 1289 bytes} [Wed Aug 31 00:37:07 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/ips => generated 152 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:37:07.645994 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-7962faea-ceb3-4aa2-ba5a-227fa71237b4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:07.652938 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-7962faea-ceb3-4aa2-ba5a-227fa71237b4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:07.660986 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7962faea-ceb3-4aa2-ba5a-227fa71237b4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:07.661479 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7962faea-ceb3-4aa2-ba5a-227fa71237b4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:07.665917 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7962faea-ceb3-4aa2-ba5a-227fa71237b4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:07.667106 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7962faea-ceb3-4aa2-ba5a-227fa71237b4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:07.667241 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7962faea-ceb3-4aa2-ba5a-227fa71237b4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:07.667577 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7962faea-ceb3-4aa2-ba5a-227fa71237b4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:07.849156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7962faea-ceb3-4aa2-ba5a-227fa71237b4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:07.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-7962faea-ceb3-4aa2-ba5a-227fa71237b4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1515 microversion: 2.1 time: 0.231895 Aug 31 00:37:07.903044 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 141/269] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:07 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1515 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:08.184938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-265dc94b-fe08-4b6a-a9fd-10bd4e49a9df tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:08.184938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-265dc94b-fe08-4b6a-a9fd-10bd4e49a9df tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:08.195589 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-265dc94b-fe08-4b6a-a9fd-10bd4e49a9df tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:08.196820 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-265dc94b-fe08-4b6a-a9fd-10bd4e49a9df tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:08.199886 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-265dc94b-fe08-4b6a-a9fd-10bd4e49a9df tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:08.201352 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-265dc94b-fe08-4b6a-a9fd-10bd4e49a9df tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:08.204450 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-265dc94b-fe08-4b6a-a9fd-10bd4e49a9df tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:08.205275 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-265dc94b-fe08-4b6a-a9fd-10bd4e49a9df tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:08.556216 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-265dc94b-fe08-4b6a-a9fd-10bd4e49a9df tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:08.567154 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-265dc94b-fe08-4b6a-a9fd-10bd4e49a9df tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1267 microversion: 2.1 time: 0.387818 Aug 31 00:37:08.568381 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 129/270] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:08 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1267 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:09.076177 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-71adfb84-b67e-49eb-9212-b48a056cf062 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-607287000", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-879339634", "security_groups": [{"name": "tempest-secgroup-smoke-1624141591"}], "networks": [{"uuid": "0b9346f3-cc4c-481e-a5c2-5077cbc6703f"}], "block_device_mapping_v2": [{"uuid": "d34941aa-e16b-42f5-84cb-74764e915ef2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:09.211010 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.network.neutron [None req-71adfb84-b67e-49eb-9212-b48a056cf062 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] validate_networks() for [('0b9346f3-cc4c-481e-a5c2-5077cbc6703f', None, None, None, None, None)] {{(pid=128049) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:37:09.572657 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-1bc3ac4e-3cf5-4316-aaa3-f73dbaa9f6aa tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:09.573242 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-1bc3ac4e-3cf5-4316-aaa3-f73dbaa9f6aa tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:09.578896 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1bc3ac4e-3cf5-4316-aaa3-f73dbaa9f6aa tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:09.579487 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1bc3ac4e-3cf5-4316-aaa3-f73dbaa9f6aa tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:09.579917 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1bc3ac4e-3cf5-4316-aaa3-f73dbaa9f6aa tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:09.580747 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1bc3ac4e-3cf5-4316-aaa3-f73dbaa9f6aa tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:09.581192 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1bc3ac4e-3cf5-4316-aaa3-f73dbaa9f6aa tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:09.581719 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1bc3ac4e-3cf5-4316-aaa3-f73dbaa9f6aa tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:09.605935 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-1bc3ac4e-3cf5-4316-aaa3-f73dbaa9f6aa tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d/ips" status: 200 len: 150 microversion: 2.1 time: 0.037204 Aug 31 00:37:09.606515 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 130/271] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 00:37:09 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:37:09.608000 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-71adfb84-b67e-49eb-9212-b48a056cf062 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Flavor limits 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:37:09.609013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-71adfb84-b67e-49eb-9212-b48a056cf062 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Image limits 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:37:09.609592 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-71adfb84-b67e-49eb-9212-b48a056cf062 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Flavor pref 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:37:09.610108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-71adfb84-b67e-49eb-9212-b48a056cf062 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Image pref 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:37:09.610710 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-71adfb84-b67e-49eb-9212-b48a056cf062 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:37:09.611088 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-2cbb895c-19db-4645-9431-ce8d069671f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:09.611683 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-2cbb895c-19db-4645-9431-ce8d069671f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:09.619039 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2cbb895c-19db-4645-9431-ce8d069671f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:09.619705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2cbb895c-19db-4645-9431-ce8d069671f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:09.620185 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2cbb895c-19db-4645-9431-ce8d069671f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:09.620905 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2cbb895c-19db-4645-9431-ce8d069671f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:09.621393 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2cbb895c-19db-4645-9431-ce8d069671f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:09.621799 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2cbb895c-19db-4645-9431-ce8d069671f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:09.625569 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-71adfb84-b67e-49eb-9212-b48a056cf062 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:09.626763 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-71adfb84-b67e-49eb-9212-b48a056cf062 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:09.627672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-71adfb84-b67e-49eb-9212-b48a056cf062 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:09.629233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-71adfb84-b67e-49eb-9212-b48a056cf062 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:09.629893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-71adfb84-b67e-49eb-9212-b48a056cf062 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:09.633401 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-71adfb84-b67e-49eb-9212-b48a056cf062 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:09.648421 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-71adfb84-b67e-49eb-9212-b48a056cf062 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Getting quotas for project 28f0cda364854dfd9fde0249a751ecf4. Resources: {'ram', 'cores', 'instances'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:37:09.652755 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-71adfb84-b67e-49eb-9212-b48a056cf062 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Getting quotas for user c639977b5f6744b9939d1e5a9745cd03 and project 28f0cda364854dfd9fde0249a751ecf4. Resources: {'ram', 'cores', 'instances'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:37:09.780170 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-2cbb895c-19db-4645-9431-ce8d069671f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:09.788554 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-2cbb895c-19db-4645-9431-ce8d069671f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1267 microversion: 2.1 time: 0.181054 Aug 31 00:37:09.789111 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 131/272] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:09 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:10.062979 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-71adfb84-b67e-49eb-9212-b48a056cf062 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Going to run 1 instances... {{(pid=128049) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:37:10.065199 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-71adfb84-b67e-49eb-9212-b48a056cf062 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d34941aa-e16b-42f5-84cb-74764e915ef2',volume_size=None,volume_type=None)] {{(pid=128049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:37:10.163371 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-358a1430-e8e0-4214-8628-82e94a7334c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Action: 'create', calling method: .version_select at 0x7f551ec30550>, body: {"keypair": {"name": "tempest-keypair-1845551870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmnxoU9eFWY3B84QNDfn7WS629ZUVpbbTnUuY/IPjIXdosGmx8T5uHXhEDa5HXOCKLYRYzzq8aXSIiY8QYoMcFKZAnGLl9vpIqwmaSB+0KnbKaIjx5+g8ISTfcCq48Uew=="}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:10.187585 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-358a1430-e8e0-4214-8628-82e94a7334c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Getting quotas for project d8aa6e0e8e6b492f8e74eea0e830c0bc. Resources: {'key_pairs'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:37:10.192752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-358a1430-e8e0-4214-8628-82e94a7334c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Getting quotas for user 77d23c99308c414f939761b07d329e03 and project d8aa6e0e8e6b492f8e74eea0e830c0bc. Resources: {'key_pairs'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:37:10.289130 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-358a1430-e8e0-4214-8628-82e94a7334c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131456 Aug 31 00:37:10.290096 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 132/273] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 00:37:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:37:10.353995 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-4f18457b-c6b4-4163-a799-8e384b523303 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:10.354521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-4f18457b-c6b4-4163-a799-8e384b523303 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:10.360572 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4f18457b-c6b4-4163-a799-8e384b523303 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:10.361053 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4f18457b-c6b4-4163-a799-8e384b523303 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:10.361485 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4f18457b-c6b4-4163-a799-8e384b523303 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:10.362172 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4f18457b-c6b4-4163-a799-8e384b523303 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:10.362625 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4f18457b-c6b4-4163-a799-8e384b523303 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:10.363155 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4f18457b-c6b4-4163-a799-8e384b523303 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:10.386795 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-4f18457b-c6b4-4163-a799-8e384b523303 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lazy-loading 'flavor' on Instance uuid dfc3d686-f358-4b8f-b983-984fd54e31e1 {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:37:10.775325 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-71adfb84-b67e-49eb-9212-b48a056cf062 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.703578 Aug 31 00:37:10.776834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 142/274] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:37:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:37:10.790707 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6d8e430b-cf45-4e11-ba39-bb003d18da8a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:10.791304 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6d8e430b-cf45-4e11-ba39-bb003d18da8a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:10.861300 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6d8e430b-cf45-4e11-ba39-bb003d18da8a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:10.868964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6d8e430b-cf45-4e11-ba39-bb003d18da8a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1087 microversion: 2.1 time: 0.083689 Aug 31 00:37:10.869535 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 143/275] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:10 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1087 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:10.880441 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-770d3723-2b77-4f2e-8f3d-5267061dea5b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:10.880441 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-770d3723-2b77-4f2e-8f3d-5267061dea5b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:10.894016 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-770d3723-2b77-4f2e-8f3d-5267061dea5b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:10.895033 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-770d3723-2b77-4f2e-8f3d-5267061dea5b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:10.895925 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-770d3723-2b77-4f2e-8f3d-5267061dea5b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:10.896683 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-770d3723-2b77-4f2e-8f3d-5267061dea5b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:10.897143 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-770d3723-2b77-4f2e-8f3d-5267061dea5b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:10.897925 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-770d3723-2b77-4f2e-8f3d-5267061dea5b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:10.945433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-4f18457b-c6b4-4163-a799-8e384b523303 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "POST /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/action" status: 202 len: 0 microversion: 2.20 time: 0.595673 Aug 31 00:37:10.948364 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 133/276] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 31 00:37:10 2022] POST /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/action => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:37:10.967599 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-0d48f87a-a041-4526-ae31-f3f6a7e95a89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:10.968517 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-0d48f87a-a041-4526-ae31-f3f6a7e95a89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:10.977510 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0d48f87a-a041-4526-ae31-f3f6a7e95a89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:10.978065 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0d48f87a-a041-4526-ae31-f3f6a7e95a89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:10.981798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0d48f87a-a041-4526-ae31-f3f6a7e95a89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:10.981798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0d48f87a-a041-4526-ae31-f3f6a7e95a89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:10.981798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0d48f87a-a041-4526-ae31-f3f6a7e95a89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:10.981798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0d48f87a-a041-4526-ae31-f3f6a7e95a89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:11.065322 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-770d3723-2b77-4f2e-8f3d-5267061dea5b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:11.074284 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-770d3723-2b77-4f2e-8f3d-5267061dea5b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1267 microversion: 2.1 time: 0.203721 Aug 31 00:37:11.074861 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 144/277] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:10 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:11.127405 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0d48f87a-a041-4526-ae31-f3f6a7e95a89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:11.136010 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0d48f87a-a041-4526-ae31-f3f6a7e95a89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:11.137503 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0d48f87a-a041-4526-ae31-f3f6a7e95a89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:11.138665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-0d48f87a-a041-4526-ae31-f3f6a7e95a89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1723 microversion: 2.20 time: 0.187696 Aug 31 00:37:11.139219 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 134/278] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:10 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:11.735600 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ec28afaa-a443-4de5-bc27-0757d2f39007 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea397145-9b79-48e8-9609-029f40765ff9"}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:11.738842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ec28afaa-a443-4de5-bc27-0757d2f39007 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:11.745355 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec28afaa-a443-4de5-bc27-0757d2f39007 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:11.745907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec28afaa-a443-4de5-bc27-0757d2f39007 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:11.746546 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec28afaa-a443-4de5-bc27-0757d2f39007 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:11.747347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec28afaa-a443-4de5-bc27-0757d2f39007 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:11.747954 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec28afaa-a443-4de5-bc27-0757d2f39007 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:11.748656 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec28afaa-a443-4de5-bc27-0757d2f39007 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:11.890070 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-636a53ce-7ad2-4a16-ad07-f887d7db75b4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:11.891020 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-636a53ce-7ad2-4a16-ad07-f887d7db75b4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:11.955366 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-636a53ce-7ad2-4a16-ad07-f887d7db75b4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:11.962443 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-636a53ce-7ad2-4a16-ad07-f887d7db75b4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1087 microversion: 2.1 time: 0.076239 Aug 31 00:37:11.963000 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 135/279] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:11 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1087 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:12.095134 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-eb21fd44-c718-4f76-89be-aa373215d52d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:12.095765 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-eb21fd44-c718-4f76-89be-aa373215d52d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:12.102780 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eb21fd44-c718-4f76-89be-aa373215d52d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:12.103318 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eb21fd44-c718-4f76-89be-aa373215d52d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:12.103747 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eb21fd44-c718-4f76-89be-aa373215d52d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:12.104458 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eb21fd44-c718-4f76-89be-aa373215d52d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:12.104902 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eb21fd44-c718-4f76-89be-aa373215d52d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:12.105316 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eb21fd44-c718-4f76-89be-aa373215d52d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:12.262790 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-eb21fd44-c718-4f76-89be-aa373215d52d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:12.271738 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-eb21fd44-c718-4f76-89be-aa373215d52d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1267 microversion: 2.1 time: 0.180450 Aug 31 00:37:12.278910 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 136/280] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:12 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:12.284628 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-2d256bca-73b9-4810-b31f-1e2eaca8a3a7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:12.285896 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-2d256bca-73b9-4810-b31f-1e2eaca8a3a7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:12.293153 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2d256bca-73b9-4810-b31f-1e2eaca8a3a7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:12.294027 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2d256bca-73b9-4810-b31f-1e2eaca8a3a7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:12.294769 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2d256bca-73b9-4810-b31f-1e2eaca8a3a7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:12.295596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2d256bca-73b9-4810-b31f-1e2eaca8a3a7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:12.296137 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2d256bca-73b9-4810-b31f-1e2eaca8a3a7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:12.296806 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2d256bca-73b9-4810-b31f-1e2eaca8a3a7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:12.314222 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:12.453416 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-2d256bca-73b9-4810-b31f-1e2eaca8a3a7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:12.466584 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-2d256bca-73b9-4810-b31f-1e2eaca8a3a7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:12.469019 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-2d256bca-73b9-4810-b31f-1e2eaca8a3a7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:12.470831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-2d256bca-73b9-4810-b31f-1e2eaca8a3a7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1723 microversion: 2.20 time: 0.190980 Aug 31 00:37:12.472372 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 137/281] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:12 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:12.680278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ec28afaa-a443-4de5-bc27-0757d2f39007 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "POST /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.948367 Aug 31 00:37:12.680892 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 145/282] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 00:37:11 2022] POST /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d/os-volume_attachments => generated 194 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:37:12.986212 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4eef88e9-4800-4b0f-85af-44a442496747 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:12.986921 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4eef88e9-4800-4b0f-85af-44a442496747 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:12.990313 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a62534a1-085a-42a6-b99c-bb2c8918f7fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-340930047", "imageRef": "12947ed8-8ca9-442d-9224-509e79a198e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "578f7ed4-d51e-4ddc-a46f-3229f20b75ab"}], "security_groups": [{"name": "tempest-securitygroup--571230468"}], "key_name": "tempest-keypair-1845551870", "user_data": "}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:12.993898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4eef88e9-4800-4b0f-85af-44a442496747 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:12.994395 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4eef88e9-4800-4b0f-85af-44a442496747 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:12.994836 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4eef88e9-4800-4b0f-85af-44a442496747 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:12.995674 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4eef88e9-4800-4b0f-85af-44a442496747 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:12.996133 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4eef88e9-4800-4b0f-85af-44a442496747 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:12.996589 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4eef88e9-4800-4b0f-85af-44a442496747 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:13.073315 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4eef88e9-4800-4b0f-85af-44a442496747 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:13.082946 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4eef88e9-4800-4b0f-85af-44a442496747 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1185 microversion: 2.1 time: 0.102263 Aug 31 00:37:13.083764 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 146/283] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:12 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:13.135914 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.network.neutron [None req-a62534a1-085a-42a6-b99c-bb2c8918f7fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] validate_networks() for [('578f7ed4-d51e-4ddc-a46f-3229f20b75ab', None, None, None, None, None)] {{(pid=128048) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:37:13.303839 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-60b9765f-31f4-4bc2-8f90-6c87e075a808 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:13.304636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-60b9765f-31f4-4bc2-8f90-6c87e075a808 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:13.311604 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-60b9765f-31f4-4bc2-8f90-6c87e075a808 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:13.313221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-60b9765f-31f4-4bc2-8f90-6c87e075a808 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:13.314031 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-60b9765f-31f4-4bc2-8f90-6c87e075a808 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:13.315296 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-60b9765f-31f4-4bc2-8f90-6c87e075a808 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:13.315910 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-60b9765f-31f4-4bc2-8f90-6c87e075a808 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:13.317527 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-60b9765f-31f4-4bc2-8f90-6c87e075a808 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:13.511597 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-60b9765f-31f4-4bc2-8f90-6c87e075a808 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:13.520748 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-60b9765f-31f4-4bc2-8f90-6c87e075a808 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1267 microversion: 2.1 time: 0.222845 Aug 31 00:37:13.522761 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 147/284] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:13 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:13.530454 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-34c661c6-2214-4b9a-9301-97261b698ed2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:13.531436 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-34c661c6-2214-4b9a-9301-97261b698ed2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:13.541146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-34c661c6-2214-4b9a-9301-97261b698ed2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:13.542158 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-34c661c6-2214-4b9a-9301-97261b698ed2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:13.542805 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-34c661c6-2214-4b9a-9301-97261b698ed2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:13.544055 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-34c661c6-2214-4b9a-9301-97261b698ed2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:13.544803 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-34c661c6-2214-4b9a-9301-97261b698ed2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:13.545635 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-34c661c6-2214-4b9a-9301-97261b698ed2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:13.676160 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-a62534a1-085a-42a6-b99c-bb2c8918f7fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Flavor limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:37:13.677679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-a62534a1-085a-42a6-b99c-bb2c8918f7fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Image limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:37:13.678355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-a62534a1-085a-42a6-b99c-bb2c8918f7fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Flavor pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:37:13.678766 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-a62534a1-085a-42a6-b99c-bb2c8918f7fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Image pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:37:13.679214 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-a62534a1-085a-42a6-b99c-bb2c8918f7fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:37:13.689287 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a62534a1-085a-42a6-b99c-bb2c8918f7fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:13.689884 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a62534a1-085a-42a6-b99c-bb2c8918f7fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:13.693462 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-34c661c6-2214-4b9a-9301-97261b698ed2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:13.703191 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-34c661c6-2214-4b9a-9301-97261b698ed2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:13.705260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-34c661c6-2214-4b9a-9301-97261b698ed2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:13.705658 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a62534a1-085a-42a6-b99c-bb2c8918f7fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:13.706598 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a62534a1-085a-42a6-b99c-bb2c8918f7fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:13.707794 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a62534a1-085a-42a6-b99c-bb2c8918f7fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:13.708021 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-34c661c6-2214-4b9a-9301-97261b698ed2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1723 microversion: 2.20 time: 0.181838 Aug 31 00:37:13.708393 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a62534a1-085a-42a6-b99c-bb2c8918f7fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:13.709342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 148/285] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:13 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:13.742528 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-a62534a1-085a-42a6-b99c-bb2c8918f7fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Getting quotas for project d8aa6e0e8e6b492f8e74eea0e830c0bc. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:37:13.746478 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-a62534a1-085a-42a6-b99c-bb2c8918f7fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Getting quotas for user 77d23c99308c414f939761b07d329e03 and project d8aa6e0e8e6b492f8e74eea0e830c0bc. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:37:13.757478 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-a62534a1-085a-42a6-b99c-bb2c8918f7fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Going to run 1 instances... {{(pid=128048) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:37:13.760268 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-a62534a1-085a-42a6-b99c-bb2c8918f7fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12947ed8-8ca9-442d-9224-509e79a198e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128048) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:37:13.891531 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a62534a1-085a-42a6-b99c-bb2c8918f7fe tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.915802 Aug 31 00:37:13.892962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 138/286] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:37:12 2022] POST /compute/v2.1/servers => generated 408 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:37:13.905272 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a51f249e-444b-433a-b20a-ba803de8811b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:13.905884 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a51f249e-444b-433a-b20a-ba803de8811b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:14.019203 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a51f249e-444b-433a-b20a-ba803de8811b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:14.027372 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a51f249e-444b-433a-b20a-ba803de8811b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1245 microversion: 2.1 time: 0.126560 Aug 31 00:37:14.027948 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 149/287] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:13 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1245 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:14.104738 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-accb77db-a768-4cce-9139-f8ea2a5c56d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:14.105925 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-accb77db-a768-4cce-9139-f8ea2a5c56d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:14.114570 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-accb77db-a768-4cce-9139-f8ea2a5c56d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:14.115043 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-accb77db-a768-4cce-9139-f8ea2a5c56d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:14.115470 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-accb77db-a768-4cce-9139-f8ea2a5c56d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:14.116263 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-accb77db-a768-4cce-9139-f8ea2a5c56d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:14.116758 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-accb77db-a768-4cce-9139-f8ea2a5c56d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:14.117150 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-accb77db-a768-4cce-9139-f8ea2a5c56d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:14.213180 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-accb77db-a768-4cce-9139-f8ea2a5c56d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:14.227830 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-accb77db-a768-4cce-9139-f8ea2a5c56d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1193 microversion: 2.1 time: 0.126823 Aug 31 00:37:14.240835 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 139/288] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:14 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1193 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:14.543967 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8036714e-1451-411b-8be8-af4db2481848 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:14.545195 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8036714e-1451-411b-8be8-af4db2481848 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:14.552637 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8036714e-1451-411b-8be8-af4db2481848 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:14.553601 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8036714e-1451-411b-8be8-af4db2481848 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:14.554198 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8036714e-1451-411b-8be8-af4db2481848 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:14.555099 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8036714e-1451-411b-8be8-af4db2481848 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:14.555558 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8036714e-1451-411b-8be8-af4db2481848 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:14.555979 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8036714e-1451-411b-8be8-af4db2481848 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:14.735645 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8036714e-1451-411b-8be8-af4db2481848 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:14.742621 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-0eafc052-62bf-42db-b80f-08b9019857cd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:14.743739 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-0eafc052-62bf-42db-b80f-08b9019857cd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:14.751979 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8036714e-1451-411b-8be8-af4db2481848 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1267 microversion: 2.1 time: 0.211931 Aug 31 00:37:14.756510 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0eafc052-62bf-42db-b80f-08b9019857cd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:14.757417 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 150/289] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:14 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:14.757561 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0eafc052-62bf-42db-b80f-08b9019857cd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:14.757934 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0eafc052-62bf-42db-b80f-08b9019857cd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:14.758775 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0eafc052-62bf-42db-b80f-08b9019857cd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:14.759244 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0eafc052-62bf-42db-b80f-08b9019857cd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:14.759818 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0eafc052-62bf-42db-b80f-08b9019857cd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:15.015804 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0eafc052-62bf-42db-b80f-08b9019857cd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:15.032125 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0eafc052-62bf-42db-b80f-08b9019857cd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:15.034381 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0eafc052-62bf-42db-b80f-08b9019857cd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:15.040134 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-0eafc052-62bf-42db-b80f-08b9019857cd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1723 microversion: 2.20 time: 0.308104 Aug 31 00:37:15.040134 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 140/290] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:14 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1723 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:37:15.053161 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ba89ce58-988d-4854-a2e1-30c900a70862 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:15.053876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ba89ce58-988d-4854-a2e1-30c900a70862 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:15.061893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ba89ce58-988d-4854-a2e1-30c900a70862 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:15.062387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ba89ce58-988d-4854-a2e1-30c900a70862 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:15.062823 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ba89ce58-988d-4854-a2e1-30c900a70862 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:15.063853 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ba89ce58-988d-4854-a2e1-30c900a70862 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:15.063973 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ba89ce58-988d-4854-a2e1-30c900a70862 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:15.072191 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ba89ce58-988d-4854-a2e1-30c900a70862 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:15.183678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ba89ce58-988d-4854-a2e1-30c900a70862 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:15.193180 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ba89ce58-988d-4854-a2e1-30c900a70862 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1249 microversion: 2.1 time: 0.146984 Aug 31 00:37:15.193902 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 151/291] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:15 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1249 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:15.249030 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-12ab50f9-e64d-4552-b579-80bbbf03ea96 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:15.249634 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-12ab50f9-e64d-4552-b579-80bbbf03ea96 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:15.256506 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-12ab50f9-e64d-4552-b579-80bbbf03ea96 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:15.257214 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-12ab50f9-e64d-4552-b579-80bbbf03ea96 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:15.257784 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-12ab50f9-e64d-4552-b579-80bbbf03ea96 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:15.258489 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-12ab50f9-e64d-4552-b579-80bbbf03ea96 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:15.258926 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-12ab50f9-e64d-4552-b579-80bbbf03ea96 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:15.259339 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-12ab50f9-e64d-4552-b579-80bbbf03ea96 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:15.404997 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-12ab50f9-e64d-4552-b579-80bbbf03ea96 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:15.413496 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-12ab50f9-e64d-4552-b579-80bbbf03ea96 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1271 microversion: 2.1 time: 0.168430 Aug 31 00:37:15.414267 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 141/292] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:15 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:15.773305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8bed411b-be6e-4feb-a219-370c07a4ea30 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:15.773929 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8bed411b-be6e-4feb-a219-370c07a4ea30 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:15.780465 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8bed411b-be6e-4feb-a219-370c07a4ea30 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:15.780940 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8bed411b-be6e-4feb-a219-370c07a4ea30 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:15.781365 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8bed411b-be6e-4feb-a219-370c07a4ea30 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:15.782045 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8bed411b-be6e-4feb-a219-370c07a4ea30 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:15.782482 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8bed411b-be6e-4feb-a219-370c07a4ea30 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:15.782891 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8bed411b-be6e-4feb-a219-370c07a4ea30 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:15.939317 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8bed411b-be6e-4feb-a219-370c07a4ea30 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:15.949655 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8bed411b-be6e-4feb-a219-370c07a4ea30 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1267 microversion: 2.1 time: 0.180115 Aug 31 00:37:15.949753 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 152/293] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:15 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:16.062527 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a5047dc5-c299-4ada-9045-ec8175294dca tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:16.063196 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-a5047dc5-c299-4ada-9045-ec8175294dca tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:16.069757 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a5047dc5-c299-4ada-9045-ec8175294dca tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:16.070530 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a5047dc5-c299-4ada-9045-ec8175294dca tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:16.070972 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a5047dc5-c299-4ada-9045-ec8175294dca tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:16.071869 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a5047dc5-c299-4ada-9045-ec8175294dca tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:16.072519 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a5047dc5-c299-4ada-9045-ec8175294dca tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:16.073034 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a5047dc5-c299-4ada-9045-ec8175294dca tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:16.214833 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-7e1b3620-ed5c-45b4-9896-4d5f610f2893 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:16.215433 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-7e1b3620-ed5c-45b4-9896-4d5f610f2893 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:16.221551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7e1b3620-ed5c-45b4-9896-4d5f610f2893 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:16.222046 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7e1b3620-ed5c-45b4-9896-4d5f610f2893 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:16.223376 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7e1b3620-ed5c-45b4-9896-4d5f610f2893 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:16.224359 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7e1b3620-ed5c-45b4-9896-4d5f610f2893 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:16.224990 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7e1b3620-ed5c-45b4-9896-4d5f610f2893 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:16.225418 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7e1b3620-ed5c-45b4-9896-4d5f610f2893 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:16.295166 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7e1b3620-ed5c-45b4-9896-4d5f610f2893 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:16.305470 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-7e1b3620-ed5c-45b4-9896-4d5f610f2893 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1241 microversion: 2.1 time: 0.094402 Aug 31 00:37:16.306285 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 153/294] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:16 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:16.345877 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-a5047dc5-c299-4ada-9045-ec8175294dca tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:16.356605 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-a5047dc5-c299-4ada-9045-ec8175294dca tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:16.358138 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-a5047dc5-c299-4ada-9045-ec8175294dca tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:16.359511 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a5047dc5-c299-4ada-9045-ec8175294dca tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1723 microversion: 2.20 time: 0.301345 Aug 31 00:37:16.360149 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 142/295] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:16 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:16.434612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-af67e10f-d6f3-44ba-ba18-fe6a6012ef0a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:16.435404 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-af67e10f-d6f3-44ba-ba18-fe6a6012ef0a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:16.443066 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-af67e10f-d6f3-44ba-ba18-fe6a6012ef0a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:16.443066 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-af67e10f-d6f3-44ba-ba18-fe6a6012ef0a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:16.443066 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-af67e10f-d6f3-44ba-ba18-fe6a6012ef0a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:16.443508 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-af67e10f-d6f3-44ba-ba18-fe6a6012ef0a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:16.443748 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-af67e10f-d6f3-44ba-ba18-fe6a6012ef0a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:16.444163 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-af67e10f-d6f3-44ba-ba18-fe6a6012ef0a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:16.594946 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-af67e10f-d6f3-44ba-ba18-fe6a6012ef0a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:16.603002 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-af67e10f-d6f3-44ba-ba18-fe6a6012ef0a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1271 microversion: 2.1 time: 0.172233 Aug 31 00:37:16.603572 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 154/296] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:16 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:16.687951 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-8ae9ef8f-ddb3-4bec-ae9d-6c80660e0a17 req-550a769a-1978-4fb5-b251-8cfca3f38894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce65669-d807-40a9-95e1-8cb85a0f03c3", "tag": "c18f4b3c-fb43-40d2-901a-6255ea8c3f61"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:16.698891 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-8ae9ef8f-ddb3-4bec-ae9d-6c80660e0a17 req-550a769a-1978-4fb5-b251-8cfca3f38894 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:16.699402 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-8ae9ef8f-ddb3-4bec-ae9d-6c80660e0a17 req-550a769a-1978-4fb5-b251-8cfca3f38894 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:16.699837 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-8ae9ef8f-ddb3-4bec-ae9d-6c80660e0a17 req-550a769a-1978-4fb5-b251-8cfca3f38894 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:16.718237 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-8ae9ef8f-ddb3-4bec-ae9d-6c80660e0a17 req-550a769a-1978-4fb5-b251-8cfca3f38894 service nova] Creating event network-changed:c18f4b3c-fb43-40d2-901a-6255ea8c3f61 for instance bce65669-d807-40a9-95e1-8cb85a0f03c3 on hv-cinder-85221 Aug 31 00:37:16.730406 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-8ae9ef8f-ddb3-4bec-ae9d-6c80660e0a17 req-550a769a-1978-4fb5-b251-8cfca3f38894 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041585 Aug 31 00:37:16.730406 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 143/297] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:37:16.970050 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-2387d1a7-901c-4e3c-b72f-f8d424bfced0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:16.970865 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-2387d1a7-901c-4e3c-b72f-f8d424bfced0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:16.977362 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2387d1a7-901c-4e3c-b72f-f8d424bfced0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:16.977838 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2387d1a7-901c-4e3c-b72f-f8d424bfced0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:16.978266 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2387d1a7-901c-4e3c-b72f-f8d424bfced0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:16.978948 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2387d1a7-901c-4e3c-b72f-f8d424bfced0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:16.979392 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2387d1a7-901c-4e3c-b72f-f8d424bfced0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:16.979811 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2387d1a7-901c-4e3c-b72f-f8d424bfced0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:17.149166 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-2387d1a7-901c-4e3c-b72f-f8d424bfced0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:17.157032 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-2387d1a7-901c-4e3c-b72f-f8d424bfced0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1267 microversion: 2.1 time: 0.191043 Aug 31 00:37:17.157588 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 155/298] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:16 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:17.327708 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9ae7829c-ed5e-48e8-ac8a-f0db2d01e6fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:17.328495 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9ae7829c-ed5e-48e8-ac8a-f0db2d01e6fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:17.335895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9ae7829c-ed5e-48e8-ac8a-f0db2d01e6fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:17.336415 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9ae7829c-ed5e-48e8-ac8a-f0db2d01e6fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:17.337031 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9ae7829c-ed5e-48e8-ac8a-f0db2d01e6fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:17.337884 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9ae7829c-ed5e-48e8-ac8a-f0db2d01e6fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:17.338584 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9ae7829c-ed5e-48e8-ac8a-f0db2d01e6fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:17.339015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9ae7829c-ed5e-48e8-ac8a-f0db2d01e6fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:17.383986 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-cfa6ee1a-0228-4450-be5b-f9cb5507140b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:17.384631 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-cfa6ee1a-0228-4450-be5b-f9cb5507140b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:17.405045 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cfa6ee1a-0228-4450-be5b-f9cb5507140b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:17.411835 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cfa6ee1a-0228-4450-be5b-f9cb5507140b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:17.411835 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cfa6ee1a-0228-4450-be5b-f9cb5507140b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:17.411835 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cfa6ee1a-0228-4450-be5b-f9cb5507140b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:17.411835 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cfa6ee1a-0228-4450-be5b-f9cb5507140b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:17.412404 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cfa6ee1a-0228-4450-be5b-f9cb5507140b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:17.612993 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-cfa6ee1a-0228-4450-be5b-f9cb5507140b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:17.629842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-cfa6ee1a-0228-4450-be5b-f9cb5507140b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:17.631817 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-cfa6ee1a-0228-4450-be5b-f9cb5507140b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:17.633638 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-cfa6ee1a-0228-4450-be5b-f9cb5507140b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1723 microversion: 2.20 time: 0.253524 Aug 31 00:37:17.635110 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 156/299] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:17 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:37:17.641033 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-1db135ea-4589-4fcb-8f0c-be5a01ffdecc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:17.642000 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-1db135ea-4589-4fcb-8f0c-be5a01ffdecc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:17.651015 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1db135ea-4589-4fcb-8f0c-be5a01ffdecc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:17.651767 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1db135ea-4589-4fcb-8f0c-be5a01ffdecc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:17.652572 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1db135ea-4589-4fcb-8f0c-be5a01ffdecc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:17.653490 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1db135ea-4589-4fcb-8f0c-be5a01ffdecc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:17.653945 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1db135ea-4589-4fcb-8f0c-be5a01ffdecc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:17.654554 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1db135ea-4589-4fcb-8f0c-be5a01ffdecc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:17.758973 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-9ae7829c-ed5e-48e8-ac8a-f0db2d01e6fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:17.775900 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9ae7829c-ed5e-48e8-ac8a-f0db2d01e6fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1305 microversion: 2.1 time: 0.452478 Aug 31 00:37:17.776770 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 144/300] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:17 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1305 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:17.834775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-1db135ea-4589-4fcb-8f0c-be5a01ffdecc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:17.845503 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-1db135ea-4589-4fcb-8f0c-be5a01ffdecc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1271 microversion: 2.1 time: 0.209121 Aug 31 00:37:17.847014 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 157/301] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:17 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1271 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:18.179800 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-cd82ed6f-cf69-4e65-bbc6-84737de9d711 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:18.180441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-cd82ed6f-cf69-4e65-bbc6-84737de9d711 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:18.187921 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cd82ed6f-cf69-4e65-bbc6-84737de9d711 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:18.188722 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cd82ed6f-cf69-4e65-bbc6-84737de9d711 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:18.189141 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cd82ed6f-cf69-4e65-bbc6-84737de9d711 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:18.193319 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cd82ed6f-cf69-4e65-bbc6-84737de9d711 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:18.193319 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cd82ed6f-cf69-4e65-bbc6-84737de9d711 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:18.193319 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cd82ed6f-cf69-4e65-bbc6-84737de9d711 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:18.498491 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-cd82ed6f-cf69-4e65-bbc6-84737de9d711 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:18.516073 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-cd82ed6f-cf69-4e65-bbc6-84737de9d711 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1267 microversion: 2.1 time: 0.340706 Aug 31 00:37:18.522980 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 145/302] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:18 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1267 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:18.658681 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8d0e6bf3-8773-4bcc-85fb-ff58ccefe8f0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:18.659979 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8d0e6bf3-8773-4bcc-85fb-ff58ccefe8f0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:18.668770 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8d0e6bf3-8773-4bcc-85fb-ff58ccefe8f0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:18.669259 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8d0e6bf3-8773-4bcc-85fb-ff58ccefe8f0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:18.669901 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8d0e6bf3-8773-4bcc-85fb-ff58ccefe8f0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:18.670766 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8d0e6bf3-8773-4bcc-85fb-ff58ccefe8f0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:18.671486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8d0e6bf3-8773-4bcc-85fb-ff58ccefe8f0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:18.671980 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8d0e6bf3-8773-4bcc-85fb-ff58ccefe8f0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:18.676803 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:18.798715 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-59d10a7b-e306-49d0-8002-9eca1216e455 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:18.800899 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-59d10a7b-e306-49d0-8002-9eca1216e455 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:18.812580 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-59d10a7b-e306-49d0-8002-9eca1216e455 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:18.814025 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-59d10a7b-e306-49d0-8002-9eca1216e455 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:18.817259 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-59d10a7b-e306-49d0-8002-9eca1216e455 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:18.818099 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-59d10a7b-e306-49d0-8002-9eca1216e455 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:18.819723 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-59d10a7b-e306-49d0-8002-9eca1216e455 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:18.820302 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-59d10a7b-e306-49d0-8002-9eca1216e455 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:18.843873 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8d0e6bf3-8773-4bcc-85fb-ff58ccefe8f0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:18.853551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8d0e6bf3-8773-4bcc-85fb-ff58ccefe8f0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:18.855272 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8d0e6bf3-8773-4bcc-85fb-ff58ccefe8f0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:18.856784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8d0e6bf3-8773-4bcc-85fb-ff58ccefe8f0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1723 microversion: 2.20 time: 0.203485 Aug 31 00:37:18.857474 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 158/303] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:18 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:18.867987 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-1fae5d29-2dbc-474f-8bc2-52090919f0d7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:18.872064 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-1fae5d29-2dbc-474f-8bc2-52090919f0d7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:18.876641 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1fae5d29-2dbc-474f-8bc2-52090919f0d7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:18.877399 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1fae5d29-2dbc-474f-8bc2-52090919f0d7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:18.877949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1fae5d29-2dbc-474f-8bc2-52090919f0d7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:18.879534 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1fae5d29-2dbc-474f-8bc2-52090919f0d7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:18.880213 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1fae5d29-2dbc-474f-8bc2-52090919f0d7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:18.880746 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1fae5d29-2dbc-474f-8bc2-52090919f0d7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:18.938765 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-59d10a7b-e306-49d0-8002-9eca1216e455 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:18.949151 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-59d10a7b-e306-49d0-8002-9eca1216e455 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1303 microversion: 2.1 time: 0.155004 Aug 31 00:37:18.949960 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 146/304] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:18 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1303 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:19.039159 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-1fae5d29-2dbc-474f-8bc2-52090919f0d7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:19.047656 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-1fae5d29-2dbc-474f-8bc2-52090919f0d7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1271 microversion: 2.1 time: 0.184084 Aug 31 00:37:19.048230 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 159/305] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:18 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:19.539006 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-768302ff-0b85-4730-8585-b58aa37739d0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:19.539800 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-768302ff-0b85-4730-8585-b58aa37739d0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:19.545990 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-768302ff-0b85-4730-8585-b58aa37739d0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:19.546476 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-768302ff-0b85-4730-8585-b58aa37739d0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:19.546905 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-768302ff-0b85-4730-8585-b58aa37739d0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:19.547779 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-768302ff-0b85-4730-8585-b58aa37739d0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:19.548444 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-768302ff-0b85-4730-8585-b58aa37739d0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:19.548869 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-768302ff-0b85-4730-8585-b58aa37739d0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:19.789172 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-768302ff-0b85-4730-8585-b58aa37739d0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:19.804625 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-768302ff-0b85-4730-8585-b58aa37739d0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1267 microversion: 2.1 time: 0.270098 Aug 31 00:37:19.818244 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 147/306] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:19 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1267 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:19.882556 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-cbc43365-fd55-43c7-b79f-8f96ba34acec tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:19.883442 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-cbc43365-fd55-43c7-b79f-8f96ba34acec tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:19.886901 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=2 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:19.891916 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cbc43365-fd55-43c7-b79f-8f96ba34acec tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:19.892549 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cbc43365-fd55-43c7-b79f-8f96ba34acec tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:19.892876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cbc43365-fd55-43c7-b79f-8f96ba34acec tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:19.893785 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cbc43365-fd55-43c7-b79f-8f96ba34acec tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:19.894950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cbc43365-fd55-43c7-b79f-8f96ba34acec tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:19.895654 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cbc43365-fd55-43c7-b79f-8f96ba34acec tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:19.981698 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-68db4238-e5e5-45b1-b5e5-0597e6b41dc0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:19.992462 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-68db4238-e5e5-45b1-b5e5-0597e6b41dc0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:19.998776 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-68db4238-e5e5-45b1-b5e5-0597e6b41dc0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:19.999337 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-68db4238-e5e5-45b1-b5e5-0597e6b41dc0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:19.999698 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-68db4238-e5e5-45b1-b5e5-0597e6b41dc0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:20.000459 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-68db4238-e5e5-45b1-b5e5-0597e6b41dc0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:20.000914 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-68db4238-e5e5-45b1-b5e5-0597e6b41dc0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:20.012511 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-68db4238-e5e5-45b1-b5e5-0597e6b41dc0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:20.058832 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-cbc43365-fd55-43c7-b79f-8f96ba34acec tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:20.087829 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-cbc43365-fd55-43c7-b79f-8f96ba34acec tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:20.089833 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-cbc43365-fd55-43c7-b79f-8f96ba34acec tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:20.091491 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-cbc43365-fd55-43c7-b79f-8f96ba34acec tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1723 microversion: 2.20 time: 0.214422 Aug 31 00:37:20.093837 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 160/307] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:19 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:20.099846 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-085ead22-c3bd-4d32-bf5c-9980dfe70a93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:20.101033 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-085ead22-c3bd-4d32-bf5c-9980dfe70a93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:20.111430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-085ead22-c3bd-4d32-bf5c-9980dfe70a93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:20.112498 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-085ead22-c3bd-4d32-bf5c-9980dfe70a93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:20.113716 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-085ead22-c3bd-4d32-bf5c-9980dfe70a93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:20.115518 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-085ead22-c3bd-4d32-bf5c-9980dfe70a93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:20.117204 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-085ead22-c3bd-4d32-bf5c-9980dfe70a93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:20.117838 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-085ead22-c3bd-4d32-bf5c-9980dfe70a93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:20.227465 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-68db4238-e5e5-45b1-b5e5-0597e6b41dc0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:20.241260 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-68db4238-e5e5-45b1-b5e5-0597e6b41dc0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1370 microversion: 2.1 time: 0.269578 Aug 31 00:37:20.243748 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 148/308] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:19 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1370 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:20.248647 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-95fa03cc-de36-45f8-86ed-b378c271dce8 req-e3c8ac51-6ce4-494e-b11a-9cace38a08e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c", "name": "network-vif-plugged", "status": "completed", "tag": "a10d4df1-cb0a-416e-86a7-7179c9f9aac0"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:20.271277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-95fa03cc-de36-45f8-86ed-b378c271dce8 req-e3c8ac51-6ce4-494e-b11a-9cace38a08e0 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:20.272208 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-95fa03cc-de36-45f8-86ed-b378c271dce8 req-e3c8ac51-6ce4-494e-b11a-9cace38a08e0 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:20.273781 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-95fa03cc-de36-45f8-86ed-b378c271dce8 req-e3c8ac51-6ce4-494e-b11a-9cace38a08e0 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:20.288312 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-95fa03cc-de36-45f8-86ed-b378c271dce8 req-e3c8ac51-6ce4-494e-b11a-9cace38a08e0 service nova] Creating event network-vif-plugged:a10d4df1-cb0a-416e-86a7-7179c9f9aac0 for instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c on hv-cinder-85221 Aug 31 00:37:20.295095 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-95fa03cc-de36-45f8-86ed-b378c271dce8 req-e3c8ac51-6ce4-494e-b11a-9cace38a08e0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049886 Aug 31 00:37:20.296012 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 149/309] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:37:20.323129 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-085ead22-c3bd-4d32-bf5c-9980dfe70a93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:20.337908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-085ead22-c3bd-4d32-bf5c-9980dfe70a93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1271 microversion: 2.1 time: 0.242550 Aug 31 00:37:20.341152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 161/310] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:20 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:20.596206 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-a27f82b8-d7b5-4b43-9714-7eee1ce67454 req-14413e4c-2d4a-456f-b48a-ef97ab8f8a15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f8fa2f-7f69-4291-903c-1618b2c28146", "tag": "28ac27c8-3511-439e-b159-a7d7f843ea7b"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:20.607327 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-a27f82b8-d7b5-4b43-9714-7eee1ce67454 req-14413e4c-2d4a-456f-b48a-ef97ab8f8a15 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:20.607800 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-a27f82b8-d7b5-4b43-9714-7eee1ce67454 req-14413e4c-2d4a-456f-b48a-ef97ab8f8a15 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:20.608231 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-a27f82b8-d7b5-4b43-9714-7eee1ce67454 req-14413e4c-2d4a-456f-b48a-ef97ab8f8a15 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:20.620139 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-a27f82b8-d7b5-4b43-9714-7eee1ce67454 req-14413e4c-2d4a-456f-b48a-ef97ab8f8a15 service nova] Creating event network-changed:28ac27c8-3511-439e-b159-a7d7f843ea7b for instance 95f8fa2f-7f69-4291-903c-1618b2c28146 on hv-cinder-85221 Aug 31 00:37:20.626245 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-a27f82b8-d7b5-4b43-9714-7eee1ce67454 req-14413e4c-2d4a-456f-b48a-ef97ab8f8a15 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034321 Aug 31 00:37:20.627156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 150/311] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:37:20.825518 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0e64ead4-5ca3-4134-8652-ed928f939d41 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:20.826130 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-0e64ead4-5ca3-4134-8652-ed928f939d41 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:20.834607 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0e64ead4-5ca3-4134-8652-ed928f939d41 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:20.835293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0e64ead4-5ca3-4134-8652-ed928f939d41 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:20.835920 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0e64ead4-5ca3-4134-8652-ed928f939d41 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:20.836839 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0e64ead4-5ca3-4134-8652-ed928f939d41 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:20.837299 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0e64ead4-5ca3-4134-8652-ed928f939d41 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:20.837730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0e64ead4-5ca3-4134-8652-ed928f939d41 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:20.986966 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-0e64ead4-5ca3-4134-8652-ed928f939d41 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:20.995370 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-0e64ead4-5ca3-4134-8652-ed928f939d41 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1267 microversion: 2.1 time: 0.173648 Aug 31 00:37:20.995944 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 162/312] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:20 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:21.118769 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f83cd843-1a91-479d-8aec-57b1b9c9fcb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:21.119828 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-f83cd843-1a91-479d-8aec-57b1b9c9fcb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:21.127281 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f83cd843-1a91-479d-8aec-57b1b9c9fcb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:21.127961 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f83cd843-1a91-479d-8aec-57b1b9c9fcb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:21.128671 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f83cd843-1a91-479d-8aec-57b1b9c9fcb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:21.129699 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f83cd843-1a91-479d-8aec-57b1b9c9fcb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:21.130616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f83cd843-1a91-479d-8aec-57b1b9c9fcb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:21.131108 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f83cd843-1a91-479d-8aec-57b1b9c9fcb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:21.263032 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-49af2a1f-cc6a-4feb-acd0-d0d7da63da80 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:21.263645 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-49af2a1f-cc6a-4feb-acd0-d0d7da63da80 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:21.269808 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-49af2a1f-cc6a-4feb-acd0-d0d7da63da80 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:21.270456 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-49af2a1f-cc6a-4feb-acd0-d0d7da63da80 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:21.270595 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f83cd843-1a91-479d-8aec-57b1b9c9fcb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:21.270901 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-49af2a1f-cc6a-4feb-acd0-d0d7da63da80 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:21.271602 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-49af2a1f-cc6a-4feb-acd0-d0d7da63da80 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:21.272059 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-49af2a1f-cc6a-4feb-acd0-d0d7da63da80 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:21.272771 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-49af2a1f-cc6a-4feb-acd0-d0d7da63da80 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:21.279717 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f83cd843-1a91-479d-8aec-57b1b9c9fcb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:21.281196 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f83cd843-1a91-479d-8aec-57b1b9c9fcb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:21.282377 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f83cd843-1a91-479d-8aec-57b1b9c9fcb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1723 microversion: 2.20 time: 0.169085 Aug 31 00:37:21.282927 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 151/313] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:21 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:21.361062 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-76accb54-e3f6-4ea3-b14e-232e053c8c48 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:21.361757 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-76accb54-e3f6-4ea3-b14e-232e053c8c48 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:21.368548 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-76accb54-e3f6-4ea3-b14e-232e053c8c48 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:21.369152 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-76accb54-e3f6-4ea3-b14e-232e053c8c48 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:21.369661 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-76accb54-e3f6-4ea3-b14e-232e053c8c48 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:21.370513 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-76accb54-e3f6-4ea3-b14e-232e053c8c48 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:21.371190 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-76accb54-e3f6-4ea3-b14e-232e053c8c48 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:21.372416 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-76accb54-e3f6-4ea3-b14e-232e053c8c48 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:21.414767 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-49af2a1f-cc6a-4feb-acd0-d0d7da63da80 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:21.423139 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-49af2a1f-cc6a-4feb-acd0-d0d7da63da80 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1370 microversion: 2.1 time: 0.163946 Aug 31 00:37:21.423831 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 163/314] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:21 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:21.680934 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-76accb54-e3f6-4ea3-b14e-232e053c8c48 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:21.688998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-76accb54-e3f6-4ea3-b14e-232e053c8c48 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1271 microversion: 2.1 time: 0.331566 Aug 31 00:37:21.690068 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 152/315] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:21 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1271 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:21.782357 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-83c21efe-9485-4450-900d-9073e5ee21c6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Action: 'create', calling method: .version_select at 0x7f551ebfe550>, body: {"keypair": {"name": "tempest-keypair-1964621660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/D8on3aGVaxPLwCZ48yExc2Yor+H4HsrLwljNJJYFMGtm5fPWIQlrubgt1lZBliZw45v4AyFYfZ6kV/nqWsGKDbY8WWRqS6OD9azKeELXfdUSWsdgH11aYeLyx+dXdvQ=="}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:21.798823 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-83c21efe-9485-4450-900d-9073e5ee21c6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Getting quotas for project ec5893d9a55f4ed28f6579397d0d6f21. Resources: {'key_pairs'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:37:21.802886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-83c21efe-9485-4450-900d-9073e5ee21c6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Getting quotas for user 45422a67a78f4784abc0f18ad84778f3 and project ec5893d9a55f4ed28f6579397d0d6f21. Resources: {'key_pairs'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:37:21.818997 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:21.889046 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-83c21efe-9485-4450-900d-9073e5ee21c6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.111091 Aug 31 00:37:21.889685 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 164/316] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 00:37:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:37:22.018444 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-0fda06c1-25be-42a5-8e5c-2e91daa302e5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:22.020715 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-0fda06c1-25be-42a5-8e5c-2e91daa302e5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:22.027012 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0fda06c1-25be-42a5-8e5c-2e91daa302e5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:22.027692 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0fda06c1-25be-42a5-8e5c-2e91daa302e5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:22.028202 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0fda06c1-25be-42a5-8e5c-2e91daa302e5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:22.028990 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0fda06c1-25be-42a5-8e5c-2e91daa302e5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:22.029501 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0fda06c1-25be-42a5-8e5c-2e91daa302e5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:22.029977 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0fda06c1-25be-42a5-8e5c-2e91daa302e5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:22.241599 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0fda06c1-25be-42a5-8e5c-2e91daa302e5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:22.250880 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-0fda06c1-25be-42a5-8e5c-2e91daa302e5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1267 microversion: 2.1 time: 0.236398 Aug 31 00:37:22.251640 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 153/317] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:22 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:22.307195 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4e6ebf8d-01e0-460b-b9bc-5245ebbb91d0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:22.307831 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4e6ebf8d-01e0-460b-b9bc-5245ebbb91d0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:22.320043 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4e6ebf8d-01e0-460b-b9bc-5245ebbb91d0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:22.320043 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4e6ebf8d-01e0-460b-b9bc-5245ebbb91d0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:22.320043 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4e6ebf8d-01e0-460b-b9bc-5245ebbb91d0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:22.320411 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4e6ebf8d-01e0-460b-b9bc-5245ebbb91d0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:22.321464 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4e6ebf8d-01e0-460b-b9bc-5245ebbb91d0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:22.322297 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4e6ebf8d-01e0-460b-b9bc-5245ebbb91d0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:22.452524 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ac83a003-d4d1-46bb-b153-56ee622aa650 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:22.453630 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ac83a003-d4d1-46bb-b153-56ee622aa650 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:22.465104 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ac83a003-d4d1-46bb-b153-56ee622aa650 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:22.465892 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ac83a003-d4d1-46bb-b153-56ee622aa650 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:22.466529 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ac83a003-d4d1-46bb-b153-56ee622aa650 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:22.467625 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ac83a003-d4d1-46bb-b153-56ee622aa650 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:22.468520 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ac83a003-d4d1-46bb-b153-56ee622aa650 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:22.469176 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ac83a003-d4d1-46bb-b153-56ee622aa650 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:22.478416 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4e6ebf8d-01e0-460b-b9bc-5245ebbb91d0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:22.490290 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4e6ebf8d-01e0-460b-b9bc-5245ebbb91d0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:22.491761 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4e6ebf8d-01e0-460b-b9bc-5245ebbb91d0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:22.492962 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4e6ebf8d-01e0-460b-b9bc-5245ebbb91d0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1723 microversion: 2.20 time: 0.189798 Aug 31 00:37:22.493523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 165/318] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:22 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:37:22.712001 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-060f6622-5196-473f-b6c8-05bf3e2e8d4a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:22.712802 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-060f6622-5196-473f-b6c8-05bf3e2e8d4a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:22.719242 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-060f6622-5196-473f-b6c8-05bf3e2e8d4a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:22.719821 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-060f6622-5196-473f-b6c8-05bf3e2e8d4a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:22.720358 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-060f6622-5196-473f-b6c8-05bf3e2e8d4a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:22.721117 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-060f6622-5196-473f-b6c8-05bf3e2e8d4a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:22.721664 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-060f6622-5196-473f-b6c8-05bf3e2e8d4a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:22.722153 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-060f6622-5196-473f-b6c8-05bf3e2e8d4a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:22.763401 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ac83a003-d4d1-46bb-b153-56ee622aa650 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:22.775513 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ac83a003-d4d1-46bb-b153-56ee622aa650 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1370 microversion: 2.1 time: 0.334725 Aug 31 00:37:22.776202 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 154/319] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:22 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1370 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:22.922520 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-060f6622-5196-473f-b6c8-05bf3e2e8d4a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:22.930981 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-060f6622-5196-473f-b6c8-05bf3e2e8d4a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1271 microversion: 2.1 time: 0.223888 Aug 31 00:37:22.931550 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 166/320] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:22 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1271 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:23.271870 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ec670670-9266-4732-a774-3110ca7dcaec tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:23.277914 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ec670670-9266-4732-a774-3110ca7dcaec tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:23.300039 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ec670670-9266-4732-a774-3110ca7dcaec tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:23.300558 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ec670670-9266-4732-a774-3110ca7dcaec tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:23.300992 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ec670670-9266-4732-a774-3110ca7dcaec tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:23.301695 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ec670670-9266-4732-a774-3110ca7dcaec tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:23.303170 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ec670670-9266-4732-a774-3110ca7dcaec tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:23.303949 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ec670670-9266-4732-a774-3110ca7dcaec tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:23.523092 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-12127d17-f75c-4b74-8f31-6973586235ef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:23.524041 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-12127d17-f75c-4b74-8f31-6973586235ef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:23.541197 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12127d17-f75c-4b74-8f31-6973586235ef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:23.541761 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12127d17-f75c-4b74-8f31-6973586235ef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:23.542205 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12127d17-f75c-4b74-8f31-6973586235ef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:23.545339 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12127d17-f75c-4b74-8f31-6973586235ef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:23.546866 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12127d17-f75c-4b74-8f31-6973586235ef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:23.547389 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12127d17-f75c-4b74-8f31-6973586235ef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:23.703798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ec670670-9266-4732-a774-3110ca7dcaec tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:23.712475 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ec670670-9266-4732-a774-3110ca7dcaec tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1454 microversion: 2.1 time: 0.444706 Aug 31 00:37:23.718905 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 155/321] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:23 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1454 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:23.734049 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c2441a2f-5889-41f9-a900-8a83c5569470 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:23.734642 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c2441a2f-5889-41f9-a900-8a83c5569470 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:23.736629 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:23.741947 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2441a2f-5889-41f9-a900-8a83c5569470 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:23.742427 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2441a2f-5889-41f9-a900-8a83c5569470 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:23.742863 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2441a2f-5889-41f9-a900-8a83c5569470 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:23.743582 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2441a2f-5889-41f9-a900-8a83c5569470 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:23.744031 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2441a2f-5889-41f9-a900-8a83c5569470 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:23.744900 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2441a2f-5889-41f9-a900-8a83c5569470 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:23.760856 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=12 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:23.818814 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-12127d17-f75c-4b74-8f31-6973586235ef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:23.827475 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-12127d17-f75c-4b74-8f31-6973586235ef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:23.828956 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-12127d17-f75c-4b74-8f31-6973586235ef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:23.830158 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-12127d17-f75c-4b74-8f31-6973586235ef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1723 microversion: 2.20 time: 0.315184 Aug 31 00:37:23.831024 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 167/322] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:23 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:23.836760 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-2cc13abd-dc74-4345-8768-6b3b930a1203 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:23.838092 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-2cc13abd-dc74-4345-8768-6b3b930a1203 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:23.846491 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2cc13abd-dc74-4345-8768-6b3b930a1203 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:23.847266 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2cc13abd-dc74-4345-8768-6b3b930a1203 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:23.847918 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2cc13abd-dc74-4345-8768-6b3b930a1203 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:23.849648 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2cc13abd-dc74-4345-8768-6b3b930a1203 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:23.850431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2cc13abd-dc74-4345-8768-6b3b930a1203 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:23.851081 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2cc13abd-dc74-4345-8768-6b3b930a1203 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:23.898810 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c2441a2f-5889-41f9-a900-8a83c5569470 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:23.901108 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=100 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:23.907393 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-c2441a2f-5889-41f9-a900-8a83c5569470 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1454 microversion: 2.1 time: 0.177052 Aug 31 00:37:23.913549 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 156/323] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:23 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1454 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:23.951345 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-70b0809c-ca66-42c3-93d2-38785fb3a6fe tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:23.952212 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-70b0809c-ca66-42c3-93d2-38785fb3a6fe tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:23.959567 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70b0809c-ca66-42c3-93d2-38785fb3a6fe tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:23.960154 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70b0809c-ca66-42c3-93d2-38785fb3a6fe tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:23.960905 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70b0809c-ca66-42c3-93d2-38785fb3a6fe tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:23.962029 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70b0809c-ca66-42c3-93d2-38785fb3a6fe tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:23.962933 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70b0809c-ca66-42c3-93d2-38785fb3a6fe tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:23.963824 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70b0809c-ca66-42c3-93d2-38785fb3a6fe tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:24.040495 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-2cc13abd-dc74-4345-8768-6b3b930a1203 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:24.052038 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-2cc13abd-dc74-4345-8768-6b3b930a1203 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1370 microversion: 2.1 time: 0.219206 Aug 31 00:37:24.053691 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 168/324] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:23 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1370 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:24.126622 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-70b0809c-ca66-42c3-93d2-38785fb3a6fe tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:24.136623 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-70b0809c-ca66-42c3-93d2-38785fb3a6fe tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1259 microversion: 2.1 time: 0.189142 Aug 31 00:37:24.138136 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 157/325] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:23 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:24.820489 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4307166e-76d6-401a-aa03-994325d1f18b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-932331050", "imageRef": "12947ed8-8ca9-442d-9224-509e79a198e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d427232-8e26-4216-9399-96dea4f30f86"}], "security_groups": [{"name": "tempest-securitygroup--1137966629"}], "key_name": "tempest-keypair-1964621660", "user_data": "}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:24.858601 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-10542a63-0bae-48ff-86f5-33ed2bd2d2e7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:24.859570 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-10542a63-0bae-48ff-86f5-33ed2bd2d2e7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:24.875010 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-10542a63-0bae-48ff-86f5-33ed2bd2d2e7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:24.875581 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-10542a63-0bae-48ff-86f5-33ed2bd2d2e7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:24.876196 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-10542a63-0bae-48ff-86f5-33ed2bd2d2e7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:24.877176 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-10542a63-0bae-48ff-86f5-33ed2bd2d2e7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:24.877634 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-10542a63-0bae-48ff-86f5-33ed2bd2d2e7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:24.878249 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-10542a63-0bae-48ff-86f5-33ed2bd2d2e7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:24.939571 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.network.neutron [None req-4307166e-76d6-401a-aa03-994325d1f18b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] validate_networks() for [('6d427232-8e26-4216-9399-96dea4f30f86', None, None, None, None, None)] {{(pid=128049) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:37:25.155959 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-10542a63-0bae-48ff-86f5-33ed2bd2d2e7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:25.167363 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-10542a63-0bae-48ff-86f5-33ed2bd2d2e7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:25.175566 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-10542a63-0bae-48ff-86f5-33ed2bd2d2e7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:25.175566 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-10542a63-0bae-48ff-86f5-33ed2bd2d2e7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1723 microversion: 2.20 time: 0.316423 Aug 31 00:37:25.175566 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 158/326] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:24 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1723 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:25.179048 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-67320202-6346-4dc0-b0b4-e970fa39477e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:25.179973 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-67320202-6346-4dc0-b0b4-e970fa39477e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:25.187105 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-67320202-6346-4dc0-b0b4-e970fa39477e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:25.187874 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-67320202-6346-4dc0-b0b4-e970fa39477e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:25.188529 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-67320202-6346-4dc0-b0b4-e970fa39477e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:25.189755 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-67320202-6346-4dc0-b0b4-e970fa39477e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:25.190352 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-67320202-6346-4dc0-b0b4-e970fa39477e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:25.190992 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-67320202-6346-4dc0-b0b4-e970fa39477e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:25.395954 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-4307166e-76d6-401a-aa03-994325d1f18b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Flavor limits 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:37:25.397972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-4307166e-76d6-401a-aa03-994325d1f18b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Image limits 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:37:25.399248 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-4307166e-76d6-401a-aa03-994325d1f18b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Flavor pref 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:37:25.399248 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-4307166e-76d6-401a-aa03-994325d1f18b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Image pref 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:37:25.399445 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-4307166e-76d6-401a-aa03-994325d1f18b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:37:25.409298 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4307166e-76d6-401a-aa03-994325d1f18b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:25.409784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4307166e-76d6-401a-aa03-994325d1f18b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:25.410223 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4307166e-76d6-401a-aa03-994325d1f18b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:25.411033 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4307166e-76d6-401a-aa03-994325d1f18b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:25.411554 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4307166e-76d6-401a-aa03-994325d1f18b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:25.411982 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4307166e-76d6-401a-aa03-994325d1f18b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:25.431960 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-4307166e-76d6-401a-aa03-994325d1f18b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Getting quotas for project ec5893d9a55f4ed28f6579397d0d6f21. Resources: {'ram', 'cores', 'instances'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:37:25.436474 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-4307166e-76d6-401a-aa03-994325d1f18b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Getting quotas for user 45422a67a78f4784abc0f18ad84778f3 and project ec5893d9a55f4ed28f6579397d0d6f21. Resources: {'ram', 'cores', 'instances'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:37:25.451014 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4307166e-76d6-401a-aa03-994325d1f18b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Going to run 1 instances... {{(pid=128049) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:37:25.453801 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4307166e-76d6-401a-aa03-994325d1f18b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12947ed8-8ca9-442d-9224-509e79a198e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:37:25.558852 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4307166e-76d6-401a-aa03-994325d1f18b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.743423 Aug 31 00:37:25.559745 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 169/327] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:37:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:37:25.564681 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-65e84d2c-00fd-4eb8-bfdb-d6222491ede4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:25.567072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-65e84d2c-00fd-4eb8-bfdb-d6222491ede4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:25.577510 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-65e84d2c-00fd-4eb8-bfdb-d6222491ede4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:25.578009 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-65e84d2c-00fd-4eb8-bfdb-d6222491ede4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:25.578630 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-65e84d2c-00fd-4eb8-bfdb-d6222491ede4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:25.578773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-67320202-6346-4dc0-b0b4-e970fa39477e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:25.579161 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-65e84d2c-00fd-4eb8-bfdb-d6222491ede4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:25.579616 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-65e84d2c-00fd-4eb8-bfdb-d6222491ede4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:25.580044 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-65e84d2c-00fd-4eb8-bfdb-d6222491ede4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:25.590563 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-67320202-6346-4dc0-b0b4-e970fa39477e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1370 microversion: 2.1 time: 0.416661 Aug 31 00:37:25.593048 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 159/328] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:25 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1370 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:25.599882 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-380fbb92-0021-4d16-a842-eaca9cda967d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:25.600743 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-380fbb92-0021-4d16-a842-eaca9cda967d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:25.718130 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-380fbb92-0021-4d16-a842-eaca9cda967d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:25.727203 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-380fbb92-0021-4d16-a842-eaca9cda967d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1241 microversion: 2.1 time: 0.132440 Aug 31 00:37:25.727998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 160/329] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:25 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1241 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:25.977964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-65e84d2c-00fd-4eb8-bfdb-d6222491ede4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:25.986227 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-65e84d2c-00fd-4eb8-bfdb-d6222491ede4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1259 microversion: 2.1 time: 0.425273 Aug 31 00:37:25.987360 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 170/330] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:25 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1259 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:26.215659 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a1d00915-0c38-4081-a59c-b1331e4caa9f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:26.216898 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-a1d00915-0c38-4081-a59c-b1331e4caa9f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:26.224811 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a1d00915-0c38-4081-a59c-b1331e4caa9f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:26.225962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a1d00915-0c38-4081-a59c-b1331e4caa9f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:26.226763 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a1d00915-0c38-4081-a59c-b1331e4caa9f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:26.227834 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a1d00915-0c38-4081-a59c-b1331e4caa9f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:26.228540 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a1d00915-0c38-4081-a59c-b1331e4caa9f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:26.229235 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a1d00915-0c38-4081-a59c-b1331e4caa9f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:26.462279 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-a1d00915-0c38-4081-a59c-b1331e4caa9f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:26.470779 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-a1d00915-0c38-4081-a59c-b1331e4caa9f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:26.472355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-a1d00915-0c38-4081-a59c-b1331e4caa9f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:26.473561 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a1d00915-0c38-4081-a59c-b1331e4caa9f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1723 microversion: 2.20 time: 0.262357 Aug 31 00:37:26.475095 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 161/331] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:26 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:37:26.622658 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3371917f-ff9b-4b16-9c43-5d1adf723b8b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:26.623384 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-3371917f-ff9b-4b16-9c43-5d1adf723b8b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:26.631340 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3371917f-ff9b-4b16-9c43-5d1adf723b8b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:26.631855 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3371917f-ff9b-4b16-9c43-5d1adf723b8b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:26.632555 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3371917f-ff9b-4b16-9c43-5d1adf723b8b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:26.633272 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3371917f-ff9b-4b16-9c43-5d1adf723b8b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:26.633776 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3371917f-ff9b-4b16-9c43-5d1adf723b8b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:26.638558 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3371917f-ff9b-4b16-9c43-5d1adf723b8b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:26.748037 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9b15c699-2611-49b0-bd8a-eceff96835d1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:26.753360 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9b15c699-2611-49b0-bd8a-eceff96835d1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:26.753360 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:26.756303 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9b15c699-2611-49b0-bd8a-eceff96835d1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:26.756999 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9b15c699-2611-49b0-bd8a-eceff96835d1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:26.757965 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9b15c699-2611-49b0-bd8a-eceff96835d1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:26.759136 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9b15c699-2611-49b0-bd8a-eceff96835d1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:26.759858 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9b15c699-2611-49b0-bd8a-eceff96835d1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:26.760633 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9b15c699-2611-49b0-bd8a-eceff96835d1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:26.795609 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-3371917f-ff9b-4b16-9c43-5d1adf723b8b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:26.804751 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-3371917f-ff9b-4b16-9c43-5d1adf723b8b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1370 microversion: 2.1 time: 0.186683 Aug 31 00:37:26.806093 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 171/332] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:26 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:26.836693 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-9b15c699-2611-49b0-bd8a-eceff96835d1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:26.848264 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9b15c699-2611-49b0-bd8a-eceff96835d1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1245 microversion: 2.1 time: 0.103981 Aug 31 00:37:26.849690 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 162/333] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:26 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:26.881705 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-eaf93c6e-c7f4-493a-b6c5-105c182ad408 req-bf1f63e0-c775-47f6-81b2-23d795bf5ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c", "tag": "a10d4df1-cb0a-416e-86a7-7179c9f9aac0"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:26.891268 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-eaf93c6e-c7f4-493a-b6c5-105c182ad408 req-bf1f63e0-c775-47f6-81b2-23d795bf5ce6 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:26.891738 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-eaf93c6e-c7f4-493a-b6c5-105c182ad408 req-bf1f63e0-c775-47f6-81b2-23d795bf5ce6 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:26.892158 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-eaf93c6e-c7f4-493a-b6c5-105c182ad408 req-bf1f63e0-c775-47f6-81b2-23d795bf5ce6 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:26.904908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-eaf93c6e-c7f4-493a-b6c5-105c182ad408 req-bf1f63e0-c775-47f6-81b2-23d795bf5ce6 service nova] Creating event network-changed:a10d4df1-cb0a-416e-86a7-7179c9f9aac0 for instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c on hv-cinder-85221 Aug 31 00:37:26.909879 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-eaf93c6e-c7f4-493a-b6c5-105c182ad408 req-bf1f63e0-c775-47f6-81b2-23d795bf5ce6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031937 Aug 31 00:37:26.910463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 172/334] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:37:27.007966 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-25a23ba8-f1e7-4493-ad16-c040c5ad7d7a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:27.008589 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-25a23ba8-f1e7-4493-ad16-c040c5ad7d7a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:27.016287 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-25a23ba8-f1e7-4493-ad16-c040c5ad7d7a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:27.016786 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-25a23ba8-f1e7-4493-ad16-c040c5ad7d7a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:27.017239 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-25a23ba8-f1e7-4493-ad16-c040c5ad7d7a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:27.017925 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-25a23ba8-f1e7-4493-ad16-c040c5ad7d7a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:27.018367 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-25a23ba8-f1e7-4493-ad16-c040c5ad7d7a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:27.018778 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-25a23ba8-f1e7-4493-ad16-c040c5ad7d7a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:27.168952 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-25a23ba8-f1e7-4493-ad16-c040c5ad7d7a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:27.177389 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-25a23ba8-f1e7-4493-ad16-c040c5ad7d7a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1259 microversion: 2.1 time: 0.173816 Aug 31 00:37:27.178130 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 163/335] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:27 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:27.502097 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-2933512e-bd3f-47fe-8a26-685a3b5d475a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:27.504196 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-2933512e-bd3f-47fe-8a26-685a3b5d475a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:27.512383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2933512e-bd3f-47fe-8a26-685a3b5d475a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:27.512995 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2933512e-bd3f-47fe-8a26-685a3b5d475a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:27.513567 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2933512e-bd3f-47fe-8a26-685a3b5d475a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:27.514588 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2933512e-bd3f-47fe-8a26-685a3b5d475a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:27.515334 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2933512e-bd3f-47fe-8a26-685a3b5d475a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:27.515978 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2933512e-bd3f-47fe-8a26-685a3b5d475a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:27.670909 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-2933512e-bd3f-47fe-8a26-685a3b5d475a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:27.682302 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-2933512e-bd3f-47fe-8a26-685a3b5d475a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:27.684263 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-2933512e-bd3f-47fe-8a26-685a3b5d475a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:27.685433 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-2933512e-bd3f-47fe-8a26-685a3b5d475a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1723 microversion: 2.20 time: 0.190076 Aug 31 00:37:27.685963 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 173/336] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:27 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:27.828090 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d7b939c1-f75d-4d57-95b6-080989f4c7f5 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:27.828725 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d7b939c1-f75d-4d57-95b6-080989f4c7f5 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:27.834850 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d7b939c1-f75d-4d57-95b6-080989f4c7f5 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:27.835325 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d7b939c1-f75d-4d57-95b6-080989f4c7f5 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:27.835752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d7b939c1-f75d-4d57-95b6-080989f4c7f5 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:27.836585 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d7b939c1-f75d-4d57-95b6-080989f4c7f5 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:27.837029 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d7b939c1-f75d-4d57-95b6-080989f4c7f5 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:27.837452 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d7b939c1-f75d-4d57-95b6-080989f4c7f5 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:27.871740 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ed1249e6-4b94-4ffb-aa4a-f5158452c460 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:27.872496 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ed1249e6-4b94-4ffb-aa4a-f5158452c460 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:27.878914 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ed1249e6-4b94-4ffb-aa4a-f5158452c460 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:27.879296 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ed1249e6-4b94-4ffb-aa4a-f5158452c460 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:27.879797 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ed1249e6-4b94-4ffb-aa4a-f5158452c460 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:27.880896 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ed1249e6-4b94-4ffb-aa4a-f5158452c460 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:27.881453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ed1249e6-4b94-4ffb-aa4a-f5158452c460 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:27.882140 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ed1249e6-4b94-4ffb-aa4a-f5158452c460 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:27.949226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ed1249e6-4b94-4ffb-aa4a-f5158452c460 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:27.957558 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ed1249e6-4b94-4ffb-aa4a-f5158452c460 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1245 microversion: 2.1 time: 0.089656 Aug 31 00:37:27.958513 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 174/337] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:27 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:27.984140 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d7b939c1-f75d-4d57-95b6-080989f4c7f5 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:27.992574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d7b939c1-f75d-4d57-95b6-080989f4c7f5 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1370 microversion: 2.1 time: 0.168968 Aug 31 00:37:27.993126 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 164/338] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:27 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:28.198518 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-cbff3494-3c46-4e8d-978e-003078eee097 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:28.199117 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-cbff3494-3c46-4e8d-978e-003078eee097 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:28.205749 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cbff3494-3c46-4e8d-978e-003078eee097 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:28.206235 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cbff3494-3c46-4e8d-978e-003078eee097 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:28.206670 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cbff3494-3c46-4e8d-978e-003078eee097 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:28.207358 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cbff3494-3c46-4e8d-978e-003078eee097 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:28.207809 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cbff3494-3c46-4e8d-978e-003078eee097 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:28.208265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cbff3494-3c46-4e8d-978e-003078eee097 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:28.356879 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-cbff3494-3c46-4e8d-978e-003078eee097 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:28.365273 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-cbff3494-3c46-4e8d-978e-003078eee097 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1259 microversion: 2.1 time: 0.170708 Aug 31 00:37:28.367540 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 175/339] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:28 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:28.716462 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-04339ace-8cae-4476-837e-638218c1e36d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:28.716975 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-04339ace-8cae-4476-837e-638218c1e36d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:28.724955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04339ace-8cae-4476-837e-638218c1e36d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:28.725426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04339ace-8cae-4476-837e-638218c1e36d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:28.725848 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04339ace-8cae-4476-837e-638218c1e36d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:28.726530 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04339ace-8cae-4476-837e-638218c1e36d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:28.727003 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04339ace-8cae-4476-837e-638218c1e36d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:28.727407 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04339ace-8cae-4476-837e-638218c1e36d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:28.861833 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-04339ace-8cae-4476-837e-638218c1e36d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:28.871002 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-04339ace-8cae-4476-837e-638218c1e36d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:28.872476 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-04339ace-8cae-4476-837e-638218c1e36d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:28.873692 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-04339ace-8cae-4476-837e-638218c1e36d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1723 microversion: 2.20 time: 0.162663 Aug 31 00:37:28.874252 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 165/340] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:28 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:28.978787 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d90d68e5-31d9-4c08-93f3-719583056033 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:28.979329 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d90d68e5-31d9-4c08-93f3-719583056033 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:28.985817 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d90d68e5-31d9-4c08-93f3-719583056033 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:28.986301 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d90d68e5-31d9-4c08-93f3-719583056033 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:28.986735 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d90d68e5-31d9-4c08-93f3-719583056033 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:28.987422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d90d68e5-31d9-4c08-93f3-719583056033 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:28.987873 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d90d68e5-31d9-4c08-93f3-719583056033 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:28.988296 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d90d68e5-31d9-4c08-93f3-719583056033 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:29.014032 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-beb2a07b-5e38-439d-9642-f05a9d78601c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:29.014637 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-beb2a07b-5e38-439d-9642-f05a9d78601c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:29.020633 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-beb2a07b-5e38-439d-9642-f05a9d78601c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:29.021149 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-beb2a07b-5e38-439d-9642-f05a9d78601c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:29.021580 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-beb2a07b-5e38-439d-9642-f05a9d78601c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:29.022278 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-beb2a07b-5e38-439d-9642-f05a9d78601c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:29.022987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-beb2a07b-5e38-439d-9642-f05a9d78601c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:29.023407 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-beb2a07b-5e38-439d-9642-f05a9d78601c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:29.057064 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d90d68e5-31d9-4c08-93f3-719583056033 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:29.065844 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d90d68e5-31d9-4c08-93f3-719583056033 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1245 microversion: 2.1 time: 0.090977 Aug 31 00:37:29.066413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 176/341] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:28 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:29.154333 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-beb2a07b-5e38-439d-9642-f05a9d78601c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:29.161952 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-beb2a07b-5e38-439d-9642-f05a9d78601c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1370 microversion: 2.1 time: 0.151682 Aug 31 00:37:29.162506 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 166/342] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:29 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:29.386831 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f611fb8c-4d0c-4775-aaf1-688d53c9de8a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:29.387819 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f611fb8c-4d0c-4775-aaf1-688d53c9de8a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:29.395455 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f611fb8c-4d0c-4775-aaf1-688d53c9de8a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:29.395614 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f611fb8c-4d0c-4775-aaf1-688d53c9de8a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:29.396207 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f611fb8c-4d0c-4775-aaf1-688d53c9de8a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:29.396995 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f611fb8c-4d0c-4775-aaf1-688d53c9de8a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:29.397468 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f611fb8c-4d0c-4775-aaf1-688d53c9de8a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:29.398145 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f611fb8c-4d0c-4775-aaf1-688d53c9de8a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:29.402662 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=100 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:29.561086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f611fb8c-4d0c-4775-aaf1-688d53c9de8a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:29.569039 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f611fb8c-4d0c-4775-aaf1-688d53c9de8a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1259 microversion: 2.1 time: 0.186015 Aug 31 00:37:29.571023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 177/343] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:29 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:29.899163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d5e6b96f-fd67-43e6-a828-07a946f87fa0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:29.899770 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d5e6b96f-fd67-43e6-a828-07a946f87fa0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:29.910631 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d5e6b96f-fd67-43e6-a828-07a946f87fa0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:29.911127 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d5e6b96f-fd67-43e6-a828-07a946f87fa0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:29.915202 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d5e6b96f-fd67-43e6-a828-07a946f87fa0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:29.916312 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d5e6b96f-fd67-43e6-a828-07a946f87fa0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:29.916812 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d5e6b96f-fd67-43e6-a828-07a946f87fa0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:29.917242 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d5e6b96f-fd67-43e6-a828-07a946f87fa0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:30.087222 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4c9a330a-3c93-4091-9979-2b3180b335ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:30.087872 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4c9a330a-3c93-4091-9979-2b3180b335ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:30.107860 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4c9a330a-3c93-4091-9979-2b3180b335ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:30.110005 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4c9a330a-3c93-4091-9979-2b3180b335ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:30.113639 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4c9a330a-3c93-4091-9979-2b3180b335ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:30.115323 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4c9a330a-3c93-4091-9979-2b3180b335ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:30.115791 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4c9a330a-3c93-4091-9979-2b3180b335ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:30.116342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4c9a330a-3c93-4091-9979-2b3180b335ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:30.195830 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4c9a330a-3c93-4091-9979-2b3180b335ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:30.203964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4c9a330a-3c93-4091-9979-2b3180b335ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1237 microversion: 2.1 time: 0.120646 Aug 31 00:37:30.204594 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 178/344] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:30 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1237 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:30.223113 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a6a85a82-ff18-480a-b367-3e626abaa15b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:30.225350 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a6a85a82-ff18-480a-b367-3e626abaa15b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:30.232067 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6a85a82-ff18-480a-b367-3e626abaa15b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:30.232594 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6a85a82-ff18-480a-b367-3e626abaa15b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:30.233206 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6a85a82-ff18-480a-b367-3e626abaa15b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:30.234079 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6a85a82-ff18-480a-b367-3e626abaa15b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:30.234718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d5e6b96f-fd67-43e6-a828-07a946f87fa0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:30.234864 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6a85a82-ff18-480a-b367-3e626abaa15b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:30.235433 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6a85a82-ff18-480a-b367-3e626abaa15b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:30.254078 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d5e6b96f-fd67-43e6-a828-07a946f87fa0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:30.255683 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d5e6b96f-fd67-43e6-a828-07a946f87fa0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:30.257116 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d5e6b96f-fd67-43e6-a828-07a946f87fa0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1723 microversion: 2.20 time: 0.363491 Aug 31 00:37:30.265271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 167/345] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:29 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1723 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:30.400719 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a6a85a82-ff18-480a-b367-3e626abaa15b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:30.408750 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a6a85a82-ff18-480a-b367-3e626abaa15b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1370 microversion: 2.1 time: 0.189423 Aug 31 00:37:30.422558 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 179/346] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:30 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:30.590863 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-14c0c386-0c55-406d-beb6-30f249165d8f tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:30.591470 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-14c0c386-0c55-406d-beb6-30f249165d8f tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:30.599014 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-14c0c386-0c55-406d-beb6-30f249165d8f tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:30.599499 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-14c0c386-0c55-406d-beb6-30f249165d8f tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:30.600290 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-14c0c386-0c55-406d-beb6-30f249165d8f tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:30.602954 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-14c0c386-0c55-406d-beb6-30f249165d8f tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:30.603616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-14c0c386-0c55-406d-beb6-30f249165d8f tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:30.604551 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-14c0c386-0c55-406d-beb6-30f249165d8f tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:30.761973 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-14c0c386-0c55-406d-beb6-30f249165d8f tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:30.776432 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-14c0c386-0c55-406d-beb6-30f249165d8f tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1259 microversion: 2.1 time: 0.184930 Aug 31 00:37:30.776432 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 168/347] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:30 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:31.225225 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-aabc82df-4323-4752-8be3-9bbeef1a49c1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:31.225830 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-aabc82df-4323-4752-8be3-9bbeef1a49c1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:31.232401 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aabc82df-4323-4752-8be3-9bbeef1a49c1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:31.232883 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aabc82df-4323-4752-8be3-9bbeef1a49c1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:31.233417 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aabc82df-4323-4752-8be3-9bbeef1a49c1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:31.234031 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aabc82df-4323-4752-8be3-9bbeef1a49c1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:31.234487 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aabc82df-4323-4752-8be3-9bbeef1a49c1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:31.234897 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aabc82df-4323-4752-8be3-9bbeef1a49c1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:31.282201 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-01a454c7-a42c-4f40-8ac3-6b0fa5c55e50 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:31.282883 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-01a454c7-a42c-4f40-8ac3-6b0fa5c55e50 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:31.289468 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-01a454c7-a42c-4f40-8ac3-6b0fa5c55e50 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:31.289944 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-01a454c7-a42c-4f40-8ac3-6b0fa5c55e50 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:31.290419 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-01a454c7-a42c-4f40-8ac3-6b0fa5c55e50 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:31.291117 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-01a454c7-a42c-4f40-8ac3-6b0fa5c55e50 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:31.291639 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-01a454c7-a42c-4f40-8ac3-6b0fa5c55e50 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:31.292265 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-01a454c7-a42c-4f40-8ac3-6b0fa5c55e50 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:31.311580 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-aabc82df-4323-4752-8be3-9bbeef1a49c1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:31.322297 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-aabc82df-4323-4752-8be3-9bbeef1a49c1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1293 microversion: 2.1 time: 0.101346 Aug 31 00:37:31.335572 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 180/348] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:31 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1293 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:31.433342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-26c4dfc3-8b09-42b4-9ffb-241e32292ee9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:31.434053 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-26c4dfc3-8b09-42b4-9ffb-241e32292ee9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:31.440665 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-26c4dfc3-8b09-42b4-9ffb-241e32292ee9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:31.449160 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-26c4dfc3-8b09-42b4-9ffb-241e32292ee9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:31.449160 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-26c4dfc3-8b09-42b4-9ffb-241e32292ee9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:31.449160 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-26c4dfc3-8b09-42b4-9ffb-241e32292ee9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:31.449160 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-26c4dfc3-8b09-42b4-9ffb-241e32292ee9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:31.449550 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-26c4dfc3-8b09-42b4-9ffb-241e32292ee9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:31.557387 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-01a454c7-a42c-4f40-8ac3-6b0fa5c55e50 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:31.571853 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-01a454c7-a42c-4f40-8ac3-6b0fa5c55e50 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:31.573659 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-01a454c7-a42c-4f40-8ac3-6b0fa5c55e50 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:31.574914 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-01a454c7-a42c-4f40-8ac3-6b0fa5c55e50 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1744 microversion: 2.20 time: 0.296612 Aug 31 00:37:31.576830 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 169/349] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:31 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1744 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:37:31.603058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-26c4dfc3-8b09-42b4-9ffb-241e32292ee9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:31.611027 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-26c4dfc3-8b09-42b4-9ffb-241e32292ee9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1370 microversion: 2.1 time: 0.185209 Aug 31 00:37:31.611598 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 181/350] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:31 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:31.794913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-1841afd2-5ac1-47e4-bd94-d8c84fec2934 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:31.795652 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-1841afd2-5ac1-47e4-bd94-d8c84fec2934 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:31.802093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1841afd2-5ac1-47e4-bd94-d8c84fec2934 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:31.806736 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1841afd2-5ac1-47e4-bd94-d8c84fec2934 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:31.806736 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1841afd2-5ac1-47e4-bd94-d8c84fec2934 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:31.806736 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1841afd2-5ac1-47e4-bd94-d8c84fec2934 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:31.806736 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1841afd2-5ac1-47e4-bd94-d8c84fec2934 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:31.807060 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1841afd2-5ac1-47e4-bd94-d8c84fec2934 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:32.048810 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-1841afd2-5ac1-47e4-bd94-d8c84fec2934 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:32.057836 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-1841afd2-5ac1-47e4-bd94-d8c84fec2934 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1259 microversion: 2.1 time: 0.267163 Aug 31 00:37:32.058733 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 170/351] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:31 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1259 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:32.343976 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a57a67f6-2ddf-400e-86c1-4be0996f2e64 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:32.344617 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a57a67f6-2ddf-400e-86c1-4be0996f2e64 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:32.352736 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a57a67f6-2ddf-400e-86c1-4be0996f2e64 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:32.353351 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a57a67f6-2ddf-400e-86c1-4be0996f2e64 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:32.353888 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a57a67f6-2ddf-400e-86c1-4be0996f2e64 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:32.354841 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a57a67f6-2ddf-400e-86c1-4be0996f2e64 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:32.355502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a57a67f6-2ddf-400e-86c1-4be0996f2e64 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:32.356131 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a57a67f6-2ddf-400e-86c1-4be0996f2e64 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:32.415102 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-880301df-558b-48c2-a6b5-6f3cdf8d5e3b req-8b0affbb-4062-44c7-bb6c-68b47812624a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f8fa2f-7f69-4291-903c-1618b2c28146", "name": "network-vif-plugged", "status": "completed", "tag": "28ac27c8-3511-439e-b159-a7d7f843ea7b"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:32.460151 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-880301df-558b-48c2-a6b5-6f3cdf8d5e3b req-8b0affbb-4062-44c7-bb6c-68b47812624a service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:32.460896 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-880301df-558b-48c2-a6b5-6f3cdf8d5e3b req-8b0affbb-4062-44c7-bb6c-68b47812624a service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:32.461500 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-880301df-558b-48c2-a6b5-6f3cdf8d5e3b req-8b0affbb-4062-44c7-bb6c-68b47812624a service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:32.486825 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-880301df-558b-48c2-a6b5-6f3cdf8d5e3b req-8b0affbb-4062-44c7-bb6c-68b47812624a service nova] Creating event network-vif-plugged:28ac27c8-3511-439e-b159-a7d7f843ea7b for instance 95f8fa2f-7f69-4291-903c-1618b2c28146 on hv-cinder-85221 Aug 31 00:37:32.502736 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-880301df-558b-48c2-a6b5-6f3cdf8d5e3b req-8b0affbb-4062-44c7-bb6c-68b47812624a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099639 Aug 31 00:37:32.503189 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 171/352] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:37:32.600563 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-457c4aa3-f3e4-49e2-8dc9-56ed24934963 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:32.601435 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-457c4aa3-f3e4-49e2-8dc9-56ed24934963 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:32.601930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a57a67f6-2ddf-400e-86c1-4be0996f2e64 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:32.612785 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a57a67f6-2ddf-400e-86c1-4be0996f2e64 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1367 microversion: 2.1 time: 0.271942 Aug 31 00:37:32.612931 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-457c4aa3-f3e4-49e2-8dc9-56ed24934963 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:32.613338 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-457c4aa3-f3e4-49e2-8dc9-56ed24934963 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:32.613768 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-457c4aa3-f3e4-49e2-8dc9-56ed24934963 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:32.614991 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-457c4aa3-f3e4-49e2-8dc9-56ed24934963 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:32.615441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-457c4aa3-f3e4-49e2-8dc9-56ed24934963 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:32.616095 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 182/353] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:32 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:32.629071 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-457c4aa3-f3e4-49e2-8dc9-56ed24934963 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:32.644194 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ee0b579a-210f-4300-8495-5f81c574cca4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:32.647452 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ee0b579a-210f-4300-8495-5f81c574cca4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:32.662862 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ee0b579a-210f-4300-8495-5f81c574cca4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:32.666401 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ee0b579a-210f-4300-8495-5f81c574cca4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:32.667035 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ee0b579a-210f-4300-8495-5f81c574cca4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:32.668626 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ee0b579a-210f-4300-8495-5f81c574cca4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:32.669405 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ee0b579a-210f-4300-8495-5f81c574cca4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:32.670067 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ee0b579a-210f-4300-8495-5f81c574cca4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:32.901071 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ee0b579a-210f-4300-8495-5f81c574cca4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:32.911805 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ee0b579a-210f-4300-8495-5f81c574cca4 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1370 microversion: 2.1 time: 0.277359 Aug 31 00:37:32.918059 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 183/354] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:32 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1370 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:33.042420 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-457c4aa3-f3e4-49e2-8dc9-56ed24934963 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:33.051245 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-457c4aa3-f3e4-49e2-8dc9-56ed24934963 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:33.053433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-457c4aa3-f3e4-49e2-8dc9-56ed24934963 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:33.054780 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-457c4aa3-f3e4-49e2-8dc9-56ed24934963 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1744 microversion: 2.20 time: 0.459306 Aug 31 00:37:33.061035 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 172/355] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:32 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1744 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:37:33.079012 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-907a85e0-bb88-4508-8bf3-d88c4148c847 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:33.079725 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-907a85e0-bb88-4508-8bf3-d88c4148c847 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:33.086111 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-907a85e0-bb88-4508-8bf3-d88c4148c847 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:33.090772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-907a85e0-bb88-4508-8bf3-d88c4148c847 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:33.090772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-907a85e0-bb88-4508-8bf3-d88c4148c847 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:33.090772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-907a85e0-bb88-4508-8bf3-d88c4148c847 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:33.090772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-907a85e0-bb88-4508-8bf3-d88c4148c847 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:33.091316 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-907a85e0-bb88-4508-8bf3-d88c4148c847 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:33.225761 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-907a85e0-bb88-4508-8bf3-d88c4148c847 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:33.236041 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-907a85e0-bb88-4508-8bf3-d88c4148c847 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1259 microversion: 2.1 time: 0.160820 Aug 31 00:37:33.236658 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 184/356] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:33 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:33.611577 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-d995d22a-6a1a-45f2-88e1-433ff4aaafb7 req-1c4a748d-c2db-43d0-a1ed-959345c11f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514a5573-d33c-4d96-bf91-d3b6e21c09dc", "tag": "e8da9c81-1278-4164-a96f-8a1a32121ece"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:33.623738 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-d995d22a-6a1a-45f2-88e1-433ff4aaafb7 req-1c4a748d-c2db-43d0-a1ed-959345c11f8c service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:33.624400 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-d995d22a-6a1a-45f2-88e1-433ff4aaafb7 req-1c4a748d-c2db-43d0-a1ed-959345c11f8c service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:33.624932 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-d995d22a-6a1a-45f2-88e1-433ff4aaafb7 req-1c4a748d-c2db-43d0-a1ed-959345c11f8c service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:33.640841 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ffc27933-2167-4f69-8a97-1ea1b59d85b6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:33.641569 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ffc27933-2167-4f69-8a97-1ea1b59d85b6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:33.657075 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-d995d22a-6a1a-45f2-88e1-433ff4aaafb7 req-1c4a748d-c2db-43d0-a1ed-959345c11f8c service nova] Creating event network-changed:e8da9c81-1278-4164-a96f-8a1a32121ece for instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc on hv-cinder-85221 Aug 31 00:37:33.663670 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ffc27933-2167-4f69-8a97-1ea1b59d85b6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:33.664161 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ffc27933-2167-4f69-8a97-1ea1b59d85b6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:33.664627 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ffc27933-2167-4f69-8a97-1ea1b59d85b6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:33.665330 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ffc27933-2167-4f69-8a97-1ea1b59d85b6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:33.665955 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ffc27933-2167-4f69-8a97-1ea1b59d85b6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:33.666107 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-d995d22a-6a1a-45f2-88e1-433ff4aaafb7 req-1c4a748d-c2db-43d0-a1ed-959345c11f8c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059459 Aug 31 00:37:33.666680 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ffc27933-2167-4f69-8a97-1ea1b59d85b6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:33.671453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 173/357] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:37:33.806354 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ffc27933-2167-4f69-8a97-1ea1b59d85b6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:33.814233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ffc27933-2167-4f69-8a97-1ea1b59d85b6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1367 microversion: 2.1 time: 0.177594 Aug 31 00:37:33.814793 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 185/358] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:33 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:33.940404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-43540b49-6393-404f-b6cc-3c2228bfd777 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:33.941090 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-43540b49-6393-404f-b6cc-3c2228bfd777 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:33.947847 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-43540b49-6393-404f-b6cc-3c2228bfd777 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:33.948370 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-43540b49-6393-404f-b6cc-3c2228bfd777 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:33.948777 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-43540b49-6393-404f-b6cc-3c2228bfd777 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:33.949456 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-43540b49-6393-404f-b6cc-3c2228bfd777 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:33.949901 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-43540b49-6393-404f-b6cc-3c2228bfd777 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:33.950319 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-43540b49-6393-404f-b6cc-3c2228bfd777 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:34.078487 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-95a09262-9c9a-447c-a34a-199e791a9b68 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:34.079365 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-95a09262-9c9a-447c-a34a-199e791a9b68 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:34.087225 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-95a09262-9c9a-447c-a34a-199e791a9b68 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:34.088066 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-95a09262-9c9a-447c-a34a-199e791a9b68 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:34.088487 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-95a09262-9c9a-447c-a34a-199e791a9b68 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:34.089235 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-95a09262-9c9a-447c-a34a-199e791a9b68 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:34.089679 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-95a09262-9c9a-447c-a34a-199e791a9b68 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:34.090379 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-95a09262-9c9a-447c-a34a-199e791a9b68 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:34.093950 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-43540b49-6393-404f-b6cc-3c2228bfd777 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:34.104509 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-43540b49-6393-404f-b6cc-3c2228bfd777 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1370 microversion: 2.1 time: 0.168248 Aug 31 00:37:34.105084 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 174/359] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:33 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:34.253787 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-95a09262-9c9a-447c-a34a-199e791a9b68 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:34.262332 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-e1d5fd33-2d95-4aa6-a448-d6100ead36d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:34.262947 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-e1d5fd33-2d95-4aa6-a448-d6100ead36d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:34.269385 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-95a09262-9c9a-447c-a34a-199e791a9b68 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:34.279949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-95a09262-9c9a-447c-a34a-199e791a9b68 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:34.280213 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e1d5fd33-2d95-4aa6-a448-d6100ead36d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:34.280213 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e1d5fd33-2d95-4aa6-a448-d6100ead36d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:34.280213 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e1d5fd33-2d95-4aa6-a448-d6100ead36d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:34.280618 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e1d5fd33-2d95-4aa6-a448-d6100ead36d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:34.281199 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e1d5fd33-2d95-4aa6-a448-d6100ead36d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:34.281625 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e1d5fd33-2d95-4aa6-a448-d6100ead36d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:34.287115 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-95a09262-9c9a-447c-a34a-199e791a9b68 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1739 microversion: 2.20 time: 0.211607 Aug 31 00:37:34.288285 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 186/360] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:34 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:37:34.444615 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-e1d5fd33-2d95-4aa6-a448-d6100ead36d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:34.448377 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=100 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:34.453229 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-e1d5fd33-2d95-4aa6-a448-d6100ead36d2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1259 microversion: 2.1 time: 0.194699 Aug 31 00:37:34.453857 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 175/361] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:34 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:34.837362 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a60c5664-16e7-4ed0-95e8-1096aaaa32f9 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:34.837976 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a60c5664-16e7-4ed0-95e8-1096aaaa32f9 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:34.844453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a60c5664-16e7-4ed0-95e8-1096aaaa32f9 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:34.845099 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a60c5664-16e7-4ed0-95e8-1096aaaa32f9 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:34.845623 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a60c5664-16e7-4ed0-95e8-1096aaaa32f9 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:34.846320 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a60c5664-16e7-4ed0-95e8-1096aaaa32f9 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:34.846801 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a60c5664-16e7-4ed0-95e8-1096aaaa32f9 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:34.847282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a60c5664-16e7-4ed0-95e8-1096aaaa32f9 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:34.983339 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a60c5664-16e7-4ed0-95e8-1096aaaa32f9 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:34.992828 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a60c5664-16e7-4ed0-95e8-1096aaaa32f9 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1367 microversion: 2.1 time: 0.161057 Aug 31 00:37:34.993396 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 187/362] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:34 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:35.127339 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a018e3b7-534e-4e98-94c7-a3f716e04d28 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:35.127952 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-a018e3b7-534e-4e98-94c7-a3f716e04d28 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:35.135522 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a018e3b7-534e-4e98-94c7-a3f716e04d28 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:35.136007 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a018e3b7-534e-4e98-94c7-a3f716e04d28 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:35.136469 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a018e3b7-534e-4e98-94c7-a3f716e04d28 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:35.137169 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a018e3b7-534e-4e98-94c7-a3f716e04d28 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:35.137619 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a018e3b7-534e-4e98-94c7-a3f716e04d28 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:35.138040 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a018e3b7-534e-4e98-94c7-a3f716e04d28 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:35.315977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6ef9b5a6-07ca-4d47-92f3-6bda8c8525dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:35.316785 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6ef9b5a6-07ca-4d47-92f3-6bda8c8525dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:35.340417 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6ef9b5a6-07ca-4d47-92f3-6bda8c8525dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:35.340918 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6ef9b5a6-07ca-4d47-92f3-6bda8c8525dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:35.341349 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6ef9b5a6-07ca-4d47-92f3-6bda8c8525dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:35.342058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6ef9b5a6-07ca-4d47-92f3-6bda8c8525dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:35.347946 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6ef9b5a6-07ca-4d47-92f3-6bda8c8525dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:35.359727 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6ef9b5a6-07ca-4d47-92f3-6bda8c8525dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:35.361853 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-a018e3b7-534e-4e98-94c7-a3f716e04d28 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:35.371575 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a018e3b7-534e-4e98-94c7-a3f716e04d28 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1370 microversion: 2.1 time: 0.248237 Aug 31 00:37:35.372399 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 176/363] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:35 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1370 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:35.420852 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=2 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:35.432113 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-27910fd1-3fed-48f4-abbb-3f3f8b0e9195 req-bf5bfd74-747e-45bc-a3ea-98a184c85261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce65669-d807-40a9-95e1-8cb85a0f03c3", "name": "network-vif-plugged", "status": "completed", "tag": "c18f4b3c-fb43-40d2-901a-6255ea8c3f61"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:35.446371 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=20 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:35.465496 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-27910fd1-3fed-48f4-abbb-3f3f8b0e9195 req-bf5bfd74-747e-45bc-a3ea-98a184c85261 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:35.468084 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-27910fd1-3fed-48f4-abbb-3f3f8b0e9195 req-bf5bfd74-747e-45bc-a3ea-98a184c85261 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:35.468565 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-27910fd1-3fed-48f4-abbb-3f3f8b0e9195 req-bf5bfd74-747e-45bc-a3ea-98a184c85261 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:35.487598 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-27910fd1-3fed-48f4-abbb-3f3f8b0e9195 req-bf5bfd74-747e-45bc-a3ea-98a184c85261 service nova] Creating event network-vif-plugged:c18f4b3c-fb43-40d2-901a-6255ea8c3f61 for instance bce65669-d807-40a9-95e1-8cb85a0f03c3 on hv-cinder-85221 Aug 31 00:37:35.494658 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-27910fd1-3fed-48f4-abbb-3f3f8b0e9195 req-bf5bfd74-747e-45bc-a3ea-98a184c85261 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074560 Aug 31 00:37:35.502124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 177/364] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:37:35.505969 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-189cbcfa-5a99-499e-b90c-e684a504cbd8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:35.507398 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-189cbcfa-5a99-499e-b90c-e684a504cbd8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:35.515379 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-189cbcfa-5a99-499e-b90c-e684a504cbd8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:35.516297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-189cbcfa-5a99-499e-b90c-e684a504cbd8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:35.516943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-189cbcfa-5a99-499e-b90c-e684a504cbd8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:35.518123 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-189cbcfa-5a99-499e-b90c-e684a504cbd8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:35.519148 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-189cbcfa-5a99-499e-b90c-e684a504cbd8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:35.519748 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-189cbcfa-5a99-499e-b90c-e684a504cbd8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:35.640128 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6ef9b5a6-07ca-4d47-92f3-6bda8c8525dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:35.651129 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6ef9b5a6-07ca-4d47-92f3-6bda8c8525dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:35.653072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6ef9b5a6-07ca-4d47-92f3-6bda8c8525dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:35.654269 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6ef9b5a6-07ca-4d47-92f3-6bda8c8525dd tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1739 microversion: 2.20 time: 0.342868 Aug 31 00:37:35.655964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 188/365] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:35 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1739 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:37:35.726985 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:35.803928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-189cbcfa-5a99-499e-b90c-e684a504cbd8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:35.816516 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-189cbcfa-5a99-499e-b90c-e684a504cbd8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1259 microversion: 2.1 time: 0.315877 Aug 31 00:37:35.818871 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 178/366] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:35 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1259 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:36.019245 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-98fdddbd-e293-424b-9d17-ea86611614d7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:36.020805 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-98fdddbd-e293-424b-9d17-ea86611614d7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:36.031857 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-98fdddbd-e293-424b-9d17-ea86611614d7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:36.032839 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-98fdddbd-e293-424b-9d17-ea86611614d7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:36.033575 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-98fdddbd-e293-424b-9d17-ea86611614d7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:36.034529 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-98fdddbd-e293-424b-9d17-ea86611614d7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:36.035650 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-98fdddbd-e293-424b-9d17-ea86611614d7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:36.038168 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-98fdddbd-e293-424b-9d17-ea86611614d7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:36.244617 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-98fdddbd-e293-424b-9d17-ea86611614d7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:36.264891 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-98fdddbd-e293-424b-9d17-ea86611614d7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1367 microversion: 2.1 time: 0.253875 Aug 31 00:37:36.266576 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 189/367] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:36 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:36.394305 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-dcde77c4-68e5-4fe3-b2b6-a8b3a77f5265 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:36.395530 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-dcde77c4-68e5-4fe3-b2b6-a8b3a77f5265 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:36.403584 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-dcde77c4-68e5-4fe3-b2b6-a8b3a77f5265 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:36.404064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-dcde77c4-68e5-4fe3-b2b6-a8b3a77f5265 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:36.404533 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-dcde77c4-68e5-4fe3-b2b6-a8b3a77f5265 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:36.405233 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-dcde77c4-68e5-4fe3-b2b6-a8b3a77f5265 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:36.405686 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-dcde77c4-68e5-4fe3-b2b6-a8b3a77f5265 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:36.406104 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-dcde77c4-68e5-4fe3-b2b6-a8b3a77f5265 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:36.624940 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-dcde77c4-68e5-4fe3-b2b6-a8b3a77f5265 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:36.636183 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-dcde77c4-68e5-4fe3-b2b6-a8b3a77f5265 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1563 microversion: 2.1 time: 0.246071 Aug 31 00:37:36.636909 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 179/368] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:36 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:36.660486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b9d6c6b1-4b00-4936-be6b-c061fece64bb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:36.660972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-b9d6c6b1-4b00-4936-be6b-c061fece64bb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:36.667505 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b9d6c6b1-4b00-4936-be6b-c061fece64bb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:36.668092 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b9d6c6b1-4b00-4936-be6b-c061fece64bb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:36.668539 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b9d6c6b1-4b00-4936-be6b-c061fece64bb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:36.669406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b9d6c6b1-4b00-4936-be6b-c061fece64bb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:36.669852 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b9d6c6b1-4b00-4936-be6b-c061fece64bb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:36.672826 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b9d6c6b1-4b00-4936-be6b-c061fece64bb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:36.681509 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-8f816799-cea7-4642-bb7f-0a848c7353d3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:36.682636 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-8f816799-cea7-4642-bb7f-0a848c7353d3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:36.690005 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8f816799-cea7-4642-bb7f-0a848c7353d3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:36.690853 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8f816799-cea7-4642-bb7f-0a848c7353d3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:36.691466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8f816799-cea7-4642-bb7f-0a848c7353d3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:36.692358 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8f816799-cea7-4642-bb7f-0a848c7353d3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:36.693684 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8f816799-cea7-4642-bb7f-0a848c7353d3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:36.694392 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8f816799-cea7-4642-bb7f-0a848c7353d3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:36.812840 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-b9d6c6b1-4b00-4936-be6b-c061fece64bb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156049 Aug 31 00:37:36.813612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 190/369] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 31 00:37:36 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:37:36.840394 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-7cee1140-518c-439d-9ac5-90cef0fac871 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:36.841215 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-7cee1140-518c-439d-9ac5-90cef0fac871 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:36.847613 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7cee1140-518c-439d-9ac5-90cef0fac871 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:36.848364 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7cee1140-518c-439d-9ac5-90cef0fac871 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:36.849000 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7cee1140-518c-439d-9ac5-90cef0fac871 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:36.849831 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7cee1140-518c-439d-9ac5-90cef0fac871 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:36.850344 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7cee1140-518c-439d-9ac5-90cef0fac871 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:36.850954 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7cee1140-518c-439d-9ac5-90cef0fac871 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:36.931524 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-8f816799-cea7-4642-bb7f-0a848c7353d3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:36.946079 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-8f816799-cea7-4642-bb7f-0a848c7353d3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:36.947446 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-8f816799-cea7-4642-bb7f-0a848c7353d3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:36.948680 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-8f816799-cea7-4642-bb7f-0a848c7353d3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1739 microversion: 2.20 time: 0.271788 Aug 31 00:37:36.964728 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 180/370] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:36 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:37.110159 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7cee1140-518c-439d-9ac5-90cef0fac871 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:37.123208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-7cee1140-518c-439d-9ac5-90cef0fac871 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1259 microversion: 2.1 time: 0.286892 Aug 31 00:37:37.148009 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 191/371] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:36 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1259 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:37.287119 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-58b4a3f2-7596-40e6-92f8-d702fe3c3d4f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:37.287808 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-58b4a3f2-7596-40e6-92f8-d702fe3c3d4f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:37.303167 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-58b4a3f2-7596-40e6-92f8-d702fe3c3d4f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:37.303167 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-58b4a3f2-7596-40e6-92f8-d702fe3c3d4f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:37.304517 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-58b4a3f2-7596-40e6-92f8-d702fe3c3d4f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:37.305267 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-58b4a3f2-7596-40e6-92f8-d702fe3c3d4f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:37.307847 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-58b4a3f2-7596-40e6-92f8-d702fe3c3d4f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:37.307847 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-58b4a3f2-7596-40e6-92f8-d702fe3c3d4f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:37.510654 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-b967543c-d3d4-485a-97e8-e3e8bcd1315c req-d6373c74-0096-4836-b6b1-7d93ef03b38e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc3d686-f358-4b8f-b983-984fd54e31e1", "name": "network-vif-plugged", "status": "completed", "tag": "e469ed11-88fc-4e04-ad53-fa40c91854d5"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:37.532613 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-b967543c-d3d4-485a-97e8-e3e8bcd1315c req-d6373c74-0096-4836-b6b1-7d93ef03b38e service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:37.533454 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-b967543c-d3d4-485a-97e8-e3e8bcd1315c req-d6373c74-0096-4836-b6b1-7d93ef03b38e service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:37.534105 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-b967543c-d3d4-485a-97e8-e3e8bcd1315c req-d6373c74-0096-4836-b6b1-7d93ef03b38e service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:37.548234 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-b967543c-d3d4-485a-97e8-e3e8bcd1315c req-d6373c74-0096-4836-b6b1-7d93ef03b38e service nova] Creating event network-vif-plugged:e469ed11-88fc-4e04-ad53-fa40c91854d5 for instance dfc3d686-f358-4b8f-b983-984fd54e31e1 on hv-cinder-85221 Aug 31 00:37:37.555141 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-b967543c-d3d4-485a-97e8-e3e8bcd1315c req-d6373c74-0096-4836-b6b1-7d93ef03b38e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048594 Aug 31 00:37:37.556093 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 192/372] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:37:37.925811 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-58b4a3f2-7596-40e6-92f8-d702fe3c3d4f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:37.944674 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-58b4a3f2-7596-40e6-92f8-d702fe3c3d4f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1367 microversion: 2.1 time: 0.658293 Aug 31 00:37:37.945899 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 181/373] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:37 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1367 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:37.975788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-025317d0-af0d-4ff2-baf7-bbe54c4f468d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:37.976628 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-025317d0-af0d-4ff2-baf7-bbe54c4f468d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:37.984049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-025317d0-af0d-4ff2-baf7-bbe54c4f468d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:37.984933 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-025317d0-af0d-4ff2-baf7-bbe54c4f468d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:37.985892 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-025317d0-af0d-4ff2-baf7-bbe54c4f468d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:37.987063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-025317d0-af0d-4ff2-baf7-bbe54c4f468d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:37.987937 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-025317d0-af0d-4ff2-baf7-bbe54c4f468d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:37.988605 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-025317d0-af0d-4ff2-baf7-bbe54c4f468d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:38.175423 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-af63210a-5cd4-436d-add2-08e523b2069c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:38.176161 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-af63210a-5cd4-436d-add2-08e523b2069c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:38.176377 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-025317d0-af0d-4ff2-baf7-bbe54c4f468d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:38.186637 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-025317d0-af0d-4ff2-baf7-bbe54c4f468d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:38.189026 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-025317d0-af0d-4ff2-baf7-bbe54c4f468d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:38.190645 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-025317d0-af0d-4ff2-baf7-bbe54c4f468d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1739 microversion: 2.20 time: 0.219656 Aug 31 00:37:38.191903 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 193/374] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:37 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:38.195649 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-af63210a-5cd4-436d-add2-08e523b2069c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:38.196126 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-af63210a-5cd4-436d-add2-08e523b2069c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:38.196598 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-af63210a-5cd4-436d-add2-08e523b2069c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:38.197308 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-af63210a-5cd4-436d-add2-08e523b2069c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:38.197861 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-af63210a-5cd4-436d-add2-08e523b2069c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:38.198289 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-af63210a-5cd4-436d-add2-08e523b2069c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:38.511556 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-af63210a-5cd4-436d-add2-08e523b2069c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:38.526178 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-af63210a-5cd4-436d-add2-08e523b2069c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1259 microversion: 2.1 time: 0.355016 Aug 31 00:37:38.527675 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 182/375] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:38 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1259 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:38.910789 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-03f907fa-fb72-491f-b224-0e558e206964 req-04c20abb-e0ab-4b00-889f-029de93767ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f8fa2f-7f69-4291-903c-1618b2c28146", "tag": "28ac27c8-3511-439e-b159-a7d7f843ea7b"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:38.921352 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-03f907fa-fb72-491f-b224-0e558e206964 req-04c20abb-e0ab-4b00-889f-029de93767ed service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:38.921824 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-03f907fa-fb72-491f-b224-0e558e206964 req-04c20abb-e0ab-4b00-889f-029de93767ed service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:38.922461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-03f907fa-fb72-491f-b224-0e558e206964 req-04c20abb-e0ab-4b00-889f-029de93767ed service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:38.933748 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-03f907fa-fb72-491f-b224-0e558e206964 req-04c20abb-e0ab-4b00-889f-029de93767ed service nova] Creating event network-changed:28ac27c8-3511-439e-b159-a7d7f843ea7b for instance 95f8fa2f-7f69-4291-903c-1618b2c28146 on hv-cinder-85221 Aug 31 00:37:38.938661 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-03f907fa-fb72-491f-b224-0e558e206964 req-04c20abb-e0ab-4b00-889f-029de93767ed service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031842 Aug 31 00:37:38.939278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 194/376] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:37:38.973660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-5ee2382e-3445-4942-9d47-e49a980edede tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:38.974429 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-5ee2382e-3445-4942-9d47-e49a980edede tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:38.980855 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5ee2382e-3445-4942-9d47-e49a980edede tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:38.981341 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5ee2382e-3445-4942-9d47-e49a980edede tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:38.981964 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5ee2382e-3445-4942-9d47-e49a980edede tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:38.982679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5ee2382e-3445-4942-9d47-e49a980edede tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:38.983126 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5ee2382e-3445-4942-9d47-e49a980edede tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:38.983563 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5ee2382e-3445-4942-9d47-e49a980edede tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:39.131373 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-5ee2382e-3445-4942-9d47-e49a980edede tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:39.135725 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-5ee2382e-3445-4942-9d47-e49a980edede tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1367 microversion: 2.1 time: 0.165925 Aug 31 00:37:39.136531 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 183/377] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:38 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:39.218040 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-639833ca-401c-4312-b93a-63ec46d15d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:39.218734 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-639833ca-401c-4312-b93a-63ec46d15d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:39.225259 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-639833ca-401c-4312-b93a-63ec46d15d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:39.225739 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-639833ca-401c-4312-b93a-63ec46d15d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:39.226169 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-639833ca-401c-4312-b93a-63ec46d15d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:39.226862 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-639833ca-401c-4312-b93a-63ec46d15d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:39.227309 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-639833ca-401c-4312-b93a-63ec46d15d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:39.227732 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-639833ca-401c-4312-b93a-63ec46d15d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:39.248255 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=100 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:39.413190 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-639833ca-401c-4312-b93a-63ec46d15d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:39.427937 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-639833ca-401c-4312-b93a-63ec46d15d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:39.441056 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-639833ca-401c-4312-b93a-63ec46d15d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:39.442393 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-639833ca-401c-4312-b93a-63ec46d15d45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1739 microversion: 2.20 time: 0.229136 Aug 31 00:37:39.442958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 195/378] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:39 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:39.547753 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f7c60ef6-705e-4d27-aea2-1198d670a1b7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:39.551263 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-f7c60ef6-705e-4d27-aea2-1198d670a1b7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:39.558909 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f7c60ef6-705e-4d27-aea2-1198d670a1b7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:39.559751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f7c60ef6-705e-4d27-aea2-1198d670a1b7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:39.560458 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f7c60ef6-705e-4d27-aea2-1198d670a1b7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:39.561805 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f7c60ef6-705e-4d27-aea2-1198d670a1b7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:39.562506 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f7c60ef6-705e-4d27-aea2-1198d670a1b7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:39.563195 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f7c60ef6-705e-4d27-aea2-1198d670a1b7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:39.912255 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f7c60ef6-705e-4d27-aea2-1198d670a1b7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:39.920713 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f7c60ef6-705e-4d27-aea2-1198d670a1b7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1443 microversion: 2.1 time: 0.377149 Aug 31 00:37:39.937123 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 184/379] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:39 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1443 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:39.951526 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-92ebb597-69c3-48bf-af5f-7df5333b8c4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:39.955494 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-92ebb597-69c3-48bf-af5f-7df5333b8c4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:39.988596 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-92ebb597-69c3-48bf-af5f-7df5333b8c4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:39.989363 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-92ebb597-69c3-48bf-af5f-7df5333b8c4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:39.990366 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-92ebb597-69c3-48bf-af5f-7df5333b8c4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:39.991075 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-92ebb597-69c3-48bf-af5f-7df5333b8c4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:39.991527 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-92ebb597-69c3-48bf-af5f-7df5333b8c4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:39.991949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-92ebb597-69c3-48bf-af5f-7df5333b8c4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:40.161431 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-168f7f1f-281d-47c7-a719-a5aeb1cb489e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:40.162668 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-168f7f1f-281d-47c7-a719-a5aeb1cb489e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:40.171120 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-168f7f1f-281d-47c7-a719-a5aeb1cb489e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:40.175051 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-168f7f1f-281d-47c7-a719-a5aeb1cb489e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:40.175716 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-168f7f1f-281d-47c7-a719-a5aeb1cb489e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:40.176659 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-168f7f1f-281d-47c7-a719-a5aeb1cb489e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:40.179819 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-168f7f1f-281d-47c7-a719-a5aeb1cb489e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:40.180730 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-168f7f1f-281d-47c7-a719-a5aeb1cb489e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:40.213988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-92ebb597-69c3-48bf-af5f-7df5333b8c4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:40.226790 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-92ebb597-69c3-48bf-af5f-7df5333b8c4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1443 microversion: 2.1 time: 0.286460 Aug 31 00:37:40.227483 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 196/380] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:39 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1443 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:40.447001 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-168f7f1f-281d-47c7-a719-a5aeb1cb489e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:40.459048 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-168f7f1f-281d-47c7-a719-a5aeb1cb489e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1367 microversion: 2.1 time: 0.304152 Aug 31 00:37:40.462346 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 185/381] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:40 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:37:40.470408 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-49f88e5c-e26f-4d23-a455-3f781f4656f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:40.471016 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-49f88e5c-e26f-4d23-a455-3f781f4656f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:40.481004 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-49f88e5c-e26f-4d23-a455-3f781f4656f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:40.481856 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-49f88e5c-e26f-4d23-a455-3f781f4656f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:40.483215 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-49f88e5c-e26f-4d23-a455-3f781f4656f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:40.484289 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-49f88e5c-e26f-4d23-a455-3f781f4656f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:40.486941 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-49f88e5c-e26f-4d23-a455-3f781f4656f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:40.487590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-49f88e5c-e26f-4d23-a455-3f781f4656f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:40.805523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-49f88e5c-e26f-4d23-a455-3f781f4656f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:40.824724 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-49f88e5c-e26f-4d23-a455-3f781f4656f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:40.826791 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-49f88e5c-e26f-4d23-a455-3f781f4656f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:40.828144 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-49f88e5c-e26f-4d23-a455-3f781f4656f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1739 microversion: 2.20 time: 0.361851 Aug 31 00:37:40.829366 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 197/382] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:40 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1739 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:41.484913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7cbc1c22-3363-4910-97bd-9535cc124d23 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:41.486675 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7cbc1c22-3363-4910-97bd-9535cc124d23 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:41.494994 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7cbc1c22-3363-4910-97bd-9535cc124d23 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:41.498293 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7cbc1c22-3363-4910-97bd-9535cc124d23 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:41.498293 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7cbc1c22-3363-4910-97bd-9535cc124d23 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:41.498293 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7cbc1c22-3363-4910-97bd-9535cc124d23 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:41.498293 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7cbc1c22-3363-4910-97bd-9535cc124d23 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:41.499127 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7cbc1c22-3363-4910-97bd-9535cc124d23 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:41.714571 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-7cbc1c22-3363-4910-97bd-9535cc124d23 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:41.727417 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-7cbc1c22-3363-4910-97bd-9535cc124d23 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1367 microversion: 2.1 time: 0.247157 Aug 31 00:37:41.733392 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 186/383] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:41 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:41.854602 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d0c8a433-59c2-473b-a76d-92e216247e64 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:41.855401 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d0c8a433-59c2-473b-a76d-92e216247e64 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:41.864413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0c8a433-59c2-473b-a76d-92e216247e64 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:41.865894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0c8a433-59c2-473b-a76d-92e216247e64 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:41.866395 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0c8a433-59c2-473b-a76d-92e216247e64 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:41.867095 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0c8a433-59c2-473b-a76d-92e216247e64 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:41.867545 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0c8a433-59c2-473b-a76d-92e216247e64 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:41.867963 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0c8a433-59c2-473b-a76d-92e216247e64 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:42.154668 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d0c8a433-59c2-473b-a76d-92e216247e64 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:42.167946 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d0c8a433-59c2-473b-a76d-92e216247e64 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:42.169422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d0c8a433-59c2-473b-a76d-92e216247e64 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:42.170816 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d0c8a433-59c2-473b-a76d-92e216247e64 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1739 microversion: 2.20 time: 0.320164 Aug 31 00:37:42.171544 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 198/384] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:41 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1739 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:37:42.759331 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-6975e5be-5326-4850-ac5f-82d9fc6d4935 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:42.760006 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-6975e5be-5326-4850-ac5f-82d9fc6d4935 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:42.766279 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6975e5be-5326-4850-ac5f-82d9fc6d4935 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:42.766806 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6975e5be-5326-4850-ac5f-82d9fc6d4935 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:42.780405 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6975e5be-5326-4850-ac5f-82d9fc6d4935 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:42.781604 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6975e5be-5326-4850-ac5f-82d9fc6d4935 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:42.782254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6975e5be-5326-4850-ac5f-82d9fc6d4935 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:42.782782 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6975e5be-5326-4850-ac5f-82d9fc6d4935 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:42.964233 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-6975e5be-5326-4850-ac5f-82d9fc6d4935 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:42.975384 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-6975e5be-5326-4850-ac5f-82d9fc6d4935 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1367 microversion: 2.1 time: 0.220040 Aug 31 00:37:42.976002 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 187/385] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:42 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:43.195987 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-569de5ca-0e81-49d3-af6e-07bab541655a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:43.197396 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-569de5ca-0e81-49d3-af6e-07bab541655a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:43.222635 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-569de5ca-0e81-49d3-af6e-07bab541655a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:43.226575 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-569de5ca-0e81-49d3-af6e-07bab541655a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:43.230562 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-569de5ca-0e81-49d3-af6e-07bab541655a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:43.234012 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-569de5ca-0e81-49d3-af6e-07bab541655a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:43.234769 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-569de5ca-0e81-49d3-af6e-07bab541655a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:43.236715 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-569de5ca-0e81-49d3-af6e-07bab541655a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:43.450242 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-0fd7831d-1358-4426-801d-0dc81e670d35 req-e093d873-d294-4cdd-a42e-ee49972c5467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce65669-d807-40a9-95e1-8cb85a0f03c3", "tag": "c18f4b3c-fb43-40d2-901a-6255ea8c3f61"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:43.468583 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-0fd7831d-1358-4426-801d-0dc81e670d35 req-e093d873-d294-4cdd-a42e-ee49972c5467 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:43.469057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-0fd7831d-1358-4426-801d-0dc81e670d35 req-e093d873-d294-4cdd-a42e-ee49972c5467 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:43.471580 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-0fd7831d-1358-4426-801d-0dc81e670d35 req-e093d873-d294-4cdd-a42e-ee49972c5467 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:43.493126 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-0fd7831d-1358-4426-801d-0dc81e670d35 req-e093d873-d294-4cdd-a42e-ee49972c5467 service nova] Creating event network-changed:c18f4b3c-fb43-40d2-901a-6255ea8c3f61 for instance bce65669-d807-40a9-95e1-8cb85a0f03c3 on hv-cinder-85221 Aug 31 00:37:43.498951 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-0fd7831d-1358-4426-801d-0dc81e670d35 req-e093d873-d294-4cdd-a42e-ee49972c5467 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052389 Aug 31 00:37:43.499754 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 188/386] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:37:43.527089 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-569de5ca-0e81-49d3-af6e-07bab541655a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:43.537347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-569de5ca-0e81-49d3-af6e-07bab541655a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:43.539214 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-569de5ca-0e81-49d3-af6e-07bab541655a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:43.540508 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-569de5ca-0e81-49d3-af6e-07bab541655a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1739 microversion: 2.20 time: 0.349567 Aug 31 00:37:43.546522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 199/387] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:43 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1739 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:43.997899 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-4c534611-a0ae-45d1-a5df-c94be949017f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:43.999173 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-4c534611-a0ae-45d1-a5df-c94be949017f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:44.006564 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4c534611-a0ae-45d1-a5df-c94be949017f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:44.007324 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4c534611-a0ae-45d1-a5df-c94be949017f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:44.007937 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4c534611-a0ae-45d1-a5df-c94be949017f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:44.008825 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4c534611-a0ae-45d1-a5df-c94be949017f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:44.009426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4c534611-a0ae-45d1-a5df-c94be949017f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:44.010023 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4c534611-a0ae-45d1-a5df-c94be949017f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:44.312360 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4c534611-a0ae-45d1-a5df-c94be949017f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:44.323107 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-4c534611-a0ae-45d1-a5df-c94be949017f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1367 microversion: 2.1 time: 0.329348 Aug 31 00:37:44.324063 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 189/388] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:43 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:44.564709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-814afd13-6443-46fd-a067-f17b407ba865 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:44.566019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-814afd13-6443-46fd-a067-f17b407ba865 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:44.572875 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-814afd13-6443-46fd-a067-f17b407ba865 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:44.573719 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-814afd13-6443-46fd-a067-f17b407ba865 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:44.574389 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-814afd13-6443-46fd-a067-f17b407ba865 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:44.575337 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-814afd13-6443-46fd-a067-f17b407ba865 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:44.575998 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-814afd13-6443-46fd-a067-f17b407ba865 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:44.576711 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-814afd13-6443-46fd-a067-f17b407ba865 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:44.741597 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-814afd13-6443-46fd-a067-f17b407ba865 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:44.750742 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-814afd13-6443-46fd-a067-f17b407ba865 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:44.752297 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-814afd13-6443-46fd-a067-f17b407ba865 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:44.753643 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-814afd13-6443-46fd-a067-f17b407ba865 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1739 microversion: 2.20 time: 0.193270 Aug 31 00:37:44.754436 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 200/389] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:44 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:45.154447 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-13c8cf0b-a602-44d1-a735-1609b6e6f172 req-96a5a222-5d69-46be-a306-5cb4c5b1548f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514a5573-d33c-4d96-bf91-d3b6e21c09dc", "name": "network-vif-plugged", "status": "completed", "tag": "e8da9c81-1278-4164-a96f-8a1a32121ece"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:45.167073 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-13c8cf0b-a602-44d1-a735-1609b6e6f172 req-96a5a222-5d69-46be-a306-5cb4c5b1548f service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:45.167922 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-13c8cf0b-a602-44d1-a735-1609b6e6f172 req-96a5a222-5d69-46be-a306-5cb4c5b1548f service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:45.168440 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-13c8cf0b-a602-44d1-a735-1609b6e6f172 req-96a5a222-5d69-46be-a306-5cb4c5b1548f service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:45.183583 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-13c8cf0b-a602-44d1-a735-1609b6e6f172 req-96a5a222-5d69-46be-a306-5cb4c5b1548f service nova] Creating event network-vif-plugged:e8da9c81-1278-4164-a96f-8a1a32121ece for instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc on hv-cinder-85221 Aug 31 00:37:45.190791 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-13c8cf0b-a602-44d1-a735-1609b6e6f172 req-96a5a222-5d69-46be-a306-5cb4c5b1548f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038120 Aug 31 00:37:45.190791 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 190/390] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:37:45.345392 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3c3148ff-6809-453c-b9b1-bfc4850d63d4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:45.346301 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-3c3148ff-6809-453c-b9b1-bfc4850d63d4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:45.352817 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3c3148ff-6809-453c-b9b1-bfc4850d63d4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:45.353450 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3c3148ff-6809-453c-b9b1-bfc4850d63d4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:45.354006 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3c3148ff-6809-453c-b9b1-bfc4850d63d4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:45.354806 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3c3148ff-6809-453c-b9b1-bfc4850d63d4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:45.355363 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3c3148ff-6809-453c-b9b1-bfc4850d63d4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:45.356107 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3c3148ff-6809-453c-b9b1-bfc4850d63d4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:45.590827 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-3c3148ff-6809-453c-b9b1-bfc4850d63d4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:45.599820 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-3c3148ff-6809-453c-b9b1-bfc4850d63d4 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1367 microversion: 2.1 time: 0.257946 Aug 31 00:37:45.615813 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 201/391] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:45 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:45.777759 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-65f5b505-aa4c-4a41-93f5-36918bf033cc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:45.778548 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-65f5b505-aa4c-4a41-93f5-36918bf033cc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:45.787869 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-65f5b505-aa4c-4a41-93f5-36918bf033cc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:45.788490 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-65f5b505-aa4c-4a41-93f5-36918bf033cc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:45.789114 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-65f5b505-aa4c-4a41-93f5-36918bf033cc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:45.790421 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-65f5b505-aa4c-4a41-93f5-36918bf033cc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:45.790931 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-65f5b505-aa4c-4a41-93f5-36918bf033cc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:45.791358 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-65f5b505-aa4c-4a41-93f5-36918bf033cc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:45.973741 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-65f5b505-aa4c-4a41-93f5-36918bf033cc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:45.986118 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-65f5b505-aa4c-4a41-93f5-36918bf033cc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:45.987735 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-65f5b505-aa4c-4a41-93f5-36918bf033cc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:45.989051 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-65f5b505-aa4c-4a41-93f5-36918bf033cc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1739 microversion: 2.20 time: 0.215948 Aug 31 00:37:45.990669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 191/392] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:45 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:46.622484 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-380e9576-98d2-4661-91b9-a152557b52c3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:46.623126 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-380e9576-98d2-4661-91b9-a152557b52c3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:46.629901 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-380e9576-98d2-4661-91b9-a152557b52c3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:46.630914 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-380e9576-98d2-4661-91b9-a152557b52c3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:46.631352 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-380e9576-98d2-4661-91b9-a152557b52c3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:46.632109 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-380e9576-98d2-4661-91b9-a152557b52c3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:46.632586 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-380e9576-98d2-4661-91b9-a152557b52c3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:46.633005 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-380e9576-98d2-4661-91b9-a152557b52c3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:46.767828 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-380e9576-98d2-4661-91b9-a152557b52c3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:46.776932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-380e9576-98d2-4661-91b9-a152557b52c3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1367 microversion: 2.1 time: 0.158848 Aug 31 00:37:46.777552 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 202/393] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:46 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:47.019246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-44fd6f44-7d5b-44f6-9c16-5440ec6b5d5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:47.019859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-44fd6f44-7d5b-44f6-9c16-5440ec6b5d5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:47.028657 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-44fd6f44-7d5b-44f6-9c16-5440ec6b5d5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:47.029139 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-44fd6f44-7d5b-44f6-9c16-5440ec6b5d5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:47.029655 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-44fd6f44-7d5b-44f6-9c16-5440ec6b5d5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:47.030375 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-44fd6f44-7d5b-44f6-9c16-5440ec6b5d5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:47.030829 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-44fd6f44-7d5b-44f6-9c16-5440ec6b5d5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:47.031247 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-44fd6f44-7d5b-44f6-9c16-5440ec6b5d5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:47.181139 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-44fd6f44-7d5b-44f6-9c16-5440ec6b5d5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:47.191218 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-44fd6f44-7d5b-44f6-9c16-5440ec6b5d5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:47.193359 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-44fd6f44-7d5b-44f6-9c16-5440ec6b5d5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:47.195001 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-44fd6f44-7d5b-44f6-9c16-5440ec6b5d5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1739 microversion: 2.20 time: 0.179729 Aug 31 00:37:47.208645 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 192/394] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:47 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:47.799423 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-204e68fe-fd94-4396-8f9d-7886730d54af tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:47.800125 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-204e68fe-fd94-4396-8f9d-7886730d54af tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:47.808766 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-204e68fe-fd94-4396-8f9d-7886730d54af tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:47.809247 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-204e68fe-fd94-4396-8f9d-7886730d54af tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:47.809675 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-204e68fe-fd94-4396-8f9d-7886730d54af tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:47.810366 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-204e68fe-fd94-4396-8f9d-7886730d54af tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:47.811144 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-204e68fe-fd94-4396-8f9d-7886730d54af tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:47.811618 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-204e68fe-fd94-4396-8f9d-7886730d54af tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:47.953258 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-204e68fe-fd94-4396-8f9d-7886730d54af tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:47.962084 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-204e68fe-fd94-4396-8f9d-7886730d54af tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1557 microversion: 2.1 time: 0.167659 Aug 31 00:37:47.962643 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 203/395] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:37:47 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:37:47.983074 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ab2ba805-afca-46f3-8f1d-be699181ce3b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:47.983594 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ab2ba805-afca-46f3-8f1d-be699181ce3b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:47.990347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ab2ba805-afca-46f3-8f1d-be699181ce3b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:47.990836 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ab2ba805-afca-46f3-8f1d-be699181ce3b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:47.991390 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ab2ba805-afca-46f3-8f1d-be699181ce3b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:47.992109 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ab2ba805-afca-46f3-8f1d-be699181ce3b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:47.992589 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ab2ba805-afca-46f3-8f1d-be699181ce3b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:47.993139 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ab2ba805-afca-46f3-8f1d-be699181ce3b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:48.073079 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ab2ba805-afca-46f3-8f1d-be699181ce3b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093874 Aug 31 00:37:48.073843 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 193/396] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 31 00:37:47 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:37:48.218787 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4cee8f55-527a-4e5e-a0b2-bb8c6b4b6e37 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:48.219408 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4cee8f55-527a-4e5e-a0b2-bb8c6b4b6e37 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:48.226931 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4cee8f55-527a-4e5e-a0b2-bb8c6b4b6e37 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:48.227426 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4cee8f55-527a-4e5e-a0b2-bb8c6b4b6e37 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:48.228036 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4cee8f55-527a-4e5e-a0b2-bb8c6b4b6e37 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:48.228861 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4cee8f55-527a-4e5e-a0b2-bb8c6b4b6e37 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:48.229221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4cee8f55-527a-4e5e-a0b2-bb8c6b4b6e37 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:48.229651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4cee8f55-527a-4e5e-a0b2-bb8c6b4b6e37 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:48.381059 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4cee8f55-527a-4e5e-a0b2-bb8c6b4b6e37 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:48.390743 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4cee8f55-527a-4e5e-a0b2-bb8c6b4b6e37 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:48.392209 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4cee8f55-527a-4e5e-a0b2-bb8c6b4b6e37 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:48.393681 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4cee8f55-527a-4e5e-a0b2-bb8c6b4b6e37 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1739 microversion: 2.20 time: 0.178843 Aug 31 00:37:48.396702 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 204/397] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:48 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:49.389676 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-c6738fbe-935d-40b3-9970-6d444f10b5c4 req-83a89baa-65b4-4669-a889-85de54bc11e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514a5573-d33c-4d96-bf91-d3b6e21c09dc", "tag": "e8da9c81-1278-4164-a96f-8a1a32121ece"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:49.400884 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-c6738fbe-935d-40b3-9970-6d444f10b5c4 req-83a89baa-65b4-4669-a889-85de54bc11e1 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:49.401626 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-c6738fbe-935d-40b3-9970-6d444f10b5c4 req-83a89baa-65b4-4669-a889-85de54bc11e1 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:49.402248 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-c6738fbe-935d-40b3-9970-6d444f10b5c4 req-83a89baa-65b4-4669-a889-85de54bc11e1 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:49.418599 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-97b7dcec-675a-43bb-a16a-e09aa3564366 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:49.419240 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-97b7dcec-675a-43bb-a16a-e09aa3564366 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:49.439616 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-97b7dcec-675a-43bb-a16a-e09aa3564366 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:49.440251 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-97b7dcec-675a-43bb-a16a-e09aa3564366 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:49.440783 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-97b7dcec-675a-43bb-a16a-e09aa3564366 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:49.441246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-c6738fbe-935d-40b3-9970-6d444f10b5c4 req-83a89baa-65b4-4669-a889-85de54bc11e1 service nova] Creating event network-changed:e8da9c81-1278-4164-a96f-8a1a32121ece for instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc on hv-cinder-85221 Aug 31 00:37:49.442073 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-97b7dcec-675a-43bb-a16a-e09aa3564366 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:49.445690 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-97b7dcec-675a-43bb-a16a-e09aa3564366 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:49.446238 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-97b7dcec-675a-43bb-a16a-e09aa3564366 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:49.458090 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-c6738fbe-935d-40b3-9970-6d444f10b5c4 req-83a89baa-65b4-4669-a889-85de54bc11e1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072084 Aug 31 00:37:49.460463 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 194/398] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:37:49.622833 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-97b7dcec-675a-43bb-a16a-e09aa3564366 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:49.635668 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-97b7dcec-675a-43bb-a16a-e09aa3564366 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:49.637420 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-97b7dcec-675a-43bb-a16a-e09aa3564366 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:49.638891 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-97b7dcec-675a-43bb-a16a-e09aa3564366 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1721 microversion: 2.20 time: 0.224361 Aug 31 00:37:49.639836 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 205/399] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:49 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:50.663974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-bfcc073b-fd45-42e1-af2f-71aa7378df83 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:50.664682 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-bfcc073b-fd45-42e1-af2f-71aa7378df83 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:50.670859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bfcc073b-fd45-42e1-af2f-71aa7378df83 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:50.671330 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bfcc073b-fd45-42e1-af2f-71aa7378df83 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:50.671751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bfcc073b-fd45-42e1-af2f-71aa7378df83 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:50.672534 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bfcc073b-fd45-42e1-af2f-71aa7378df83 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:50.672965 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bfcc073b-fd45-42e1-af2f-71aa7378df83 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:50.673377 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bfcc073b-fd45-42e1-af2f-71aa7378df83 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:50.689129 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=100 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:50.813876 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-bfcc073b-fd45-42e1-af2f-71aa7378df83 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:50.823004 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-bfcc073b-fd45-42e1-af2f-71aa7378df83 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:50.824487 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-bfcc073b-fd45-42e1-af2f-71aa7378df83 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:50.825643 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-bfcc073b-fd45-42e1-af2f-71aa7378df83 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1721 microversion: 2.20 time: 0.166316 Aug 31 00:37:50.826195 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 195/400] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:50 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:37:51.849599 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a762f711-5d11-499e-9144-f42db4616576 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:51.850281 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a762f711-5d11-499e-9144-f42db4616576 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:51.852658 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:51.857386 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a762f711-5d11-499e-9144-f42db4616576 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:51.857862 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a762f711-5d11-499e-9144-f42db4616576 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:51.858305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a762f711-5d11-499e-9144-f42db4616576 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:51.858988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a762f711-5d11-499e-9144-f42db4616576 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:51.859473 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a762f711-5d11-499e-9144-f42db4616576 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:51.859888 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a762f711-5d11-499e-9144-f42db4616576 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:51.994938 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a762f711-5d11-499e-9144-f42db4616576 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:52.002956 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a762f711-5d11-499e-9144-f42db4616576 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:52.004402 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a762f711-5d11-499e-9144-f42db4616576 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:52.005548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a762f711-5d11-499e-9144-f42db4616576 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1721 microversion: 2.20 time: 0.159926 Aug 31 00:37:52.006097 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 206/401] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:51 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:53.030289 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ec12237c-e4cd-4ef0-a889-db8516724fa2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:53.030932 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ec12237c-e4cd-4ef0-a889-db8516724fa2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:53.043330 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ec12237c-e4cd-4ef0-a889-db8516724fa2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:53.043825 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ec12237c-e4cd-4ef0-a889-db8516724fa2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:53.044286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ec12237c-e4cd-4ef0-a889-db8516724fa2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:53.045017 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ec12237c-e4cd-4ef0-a889-db8516724fa2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:53.045462 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ec12237c-e4cd-4ef0-a889-db8516724fa2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:53.045883 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ec12237c-e4cd-4ef0-a889-db8516724fa2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:53.047105 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-164ac6df-3e90-45db-8199-385332af5818 req-733fc492-8232-4399-9436-b3746e3e0828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc3d686-f358-4b8f-b983-984fd54e31e1", "name": "network-vif-unplugged", "status": "completed", "tag": "e469ed11-88fc-4e04-ad53-fa40c91854d5"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:53.058658 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-164ac6df-3e90-45db-8199-385332af5818 req-733fc492-8232-4399-9436-b3746e3e0828 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:53.059308 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-164ac6df-3e90-45db-8199-385332af5818 req-733fc492-8232-4399-9436-b3746e3e0828 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:53.059739 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-164ac6df-3e90-45db-8199-385332af5818 req-733fc492-8232-4399-9436-b3746e3e0828 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:53.077042 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-164ac6df-3e90-45db-8199-385332af5818 req-733fc492-8232-4399-9436-b3746e3e0828 service nova] Creating event network-vif-unplugged:e469ed11-88fc-4e04-ad53-fa40c91854d5 for instance dfc3d686-f358-4b8f-b983-984fd54e31e1 on hv-cinder-85221 Aug 31 00:37:53.082133 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-164ac6df-3e90-45db-8199-385332af5818 req-733fc492-8232-4399-9436-b3746e3e0828 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038563 Aug 31 00:37:53.083070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 207/402] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:37:53.268999 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ec12237c-e4cd-4ef0-a889-db8516724fa2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:53.286177 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ec12237c-e4cd-4ef0-a889-db8516724fa2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:53.288180 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ec12237c-e4cd-4ef0-a889-db8516724fa2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:53.289699 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ec12237c-e4cd-4ef0-a889-db8516724fa2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1724 microversion: 2.20 time: 0.263339 Aug 31 00:37:53.308965 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 196/403] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:53 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:53.316271 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-296eb4d7-90f8-410f-8966-714586010121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da73a060-befd-464a-9d40-67d753756757"}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:53.318942 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-296eb4d7-90f8-410f-8966-714586010121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:53.325471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-296eb4d7-90f8-410f-8966-714586010121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:53.325963 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-296eb4d7-90f8-410f-8966-714586010121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:53.326390 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-296eb4d7-90f8-410f-8966-714586010121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:53.327402 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-296eb4d7-90f8-410f-8966-714586010121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:53.327849 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-296eb4d7-90f8-410f-8966-714586010121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:53.328749 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-296eb4d7-90f8-410f-8966-714586010121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:54.246797 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-296eb4d7-90f8-410f-8966-714586010121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "POST /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.934833 Aug 31 00:37:54.247446 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 208/404] 10.222.0.65 () {62 vars in 1364 bytes} [Wed Aug 31 00:37:53 2022] POST /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/os-volume_attachments => generated 188 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:37:54.370343 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-6e0a382f-c9ba-4a7d-8f72-837d68b613a0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:37:54.370957 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-6e0a382f-c9ba-4a7d-8f72-837d68b613a0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:54.378072 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6e0a382f-c9ba-4a7d-8f72-837d68b613a0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:54.378072 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6e0a382f-c9ba-4a7d-8f72-837d68b613a0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:54.378072 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6e0a382f-c9ba-4a7d-8f72-837d68b613a0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:54.379438 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6e0a382f-c9ba-4a7d-8f72-837d68b613a0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:54.379438 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6e0a382f-c9ba-4a7d-8f72-837d68b613a0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:54.379606 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6e0a382f-c9ba-4a7d-8f72-837d68b613a0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:54.423016 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-6e0a382f-c9ba-4a7d-8f72-837d68b613a0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128048) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 00:37:54.702014 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-6e0a382f-c9ba-4a7d-8f72-837d68b613a0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "POST /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/action" status: 202 len: 0 microversion: 2.20 time: 0.336167 Aug 31 00:37:54.702601 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 197/405] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 31 00:37:54 2022] POST /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:37:54.710936 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-7e60979f-43b0-4ba9-9c55-85e269a04306 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:54.711622 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-7e60979f-43b0-4ba9-9c55-85e269a04306 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:54.717883 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7e60979f-43b0-4ba9-9c55-85e269a04306 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:54.718380 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7e60979f-43b0-4ba9-9c55-85e269a04306 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:54.718815 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7e60979f-43b0-4ba9-9c55-85e269a04306 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:54.719540 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7e60979f-43b0-4ba9-9c55-85e269a04306 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:54.719964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7e60979f-43b0-4ba9-9c55-85e269a04306 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:54.720402 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7e60979f-43b0-4ba9-9c55-85e269a04306 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:54.870726 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7e60979f-43b0-4ba9-9c55-85e269a04306 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:54.881628 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7e60979f-43b0-4ba9-9c55-85e269a04306 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:54.891746 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7e60979f-43b0-4ba9-9c55-85e269a04306 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:54.891746 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-7e60979f-43b0-4ba9-9c55-85e269a04306 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1750 microversion: 2.20 time: 0.177489 Aug 31 00:37:54.891746 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 209/406] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:54 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1750 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:37:55.908164 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-4c9683ad-0cc9-4c24-86ff-039ec79f4bdc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:55.908825 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-4c9683ad-0cc9-4c24-86ff-039ec79f4bdc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:55.915404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4c9683ad-0cc9-4c24-86ff-039ec79f4bdc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:55.915923 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4c9683ad-0cc9-4c24-86ff-039ec79f4bdc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:55.916390 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4c9683ad-0cc9-4c24-86ff-039ec79f4bdc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:55.917153 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4c9683ad-0cc9-4c24-86ff-039ec79f4bdc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:55.917617 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4c9683ad-0cc9-4c24-86ff-039ec79f4bdc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:55.918040 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4c9683ad-0cc9-4c24-86ff-039ec79f4bdc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:56.090731 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4c9683ad-0cc9-4c24-86ff-039ec79f4bdc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:56.097499 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4c9683ad-0cc9-4c24-86ff-039ec79f4bdc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:56.099052 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4c9683ad-0cc9-4c24-86ff-039ec79f4bdc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:56.100420 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-4c9683ad-0cc9-4c24-86ff-039ec79f4bdc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1750 microversion: 2.20 time: 0.196033 Aug 31 00:37:56.101385 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 198/407] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:55 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1750 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:57.123618 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3ab1897c-da90-46aa-9add-8301785ac2b2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:57.124130 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-3ab1897c-da90-46aa-9add-8301785ac2b2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:57.130734 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3ab1897c-da90-46aa-9add-8301785ac2b2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:57.131214 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3ab1897c-da90-46aa-9add-8301785ac2b2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:57.131646 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3ab1897c-da90-46aa-9add-8301785ac2b2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:57.132348 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3ab1897c-da90-46aa-9add-8301785ac2b2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:57.133306 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3ab1897c-da90-46aa-9add-8301785ac2b2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:57.133722 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3ab1897c-da90-46aa-9add-8301785ac2b2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:57.137918 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:57.265181 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-3ab1897c-da90-46aa-9add-8301785ac2b2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:57.275138 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-3ab1897c-da90-46aa-9add-8301785ac2b2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:57.276628 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-3ab1897c-da90-46aa-9add-8301785ac2b2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:57.277838 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-3ab1897c-da90-46aa-9add-8301785ac2b2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1752 microversion: 2.20 time: 0.158270 Aug 31 00:37:57.278417 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 210/408] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:57 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:37:58.301976 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-233d8f60-a659-498a-bdf3-37142d7d5e90 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:58.305886 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-233d8f60-a659-498a-bdf3-37142d7d5e90 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:58.305886 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:58.309771 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-233d8f60-a659-498a-bdf3-37142d7d5e90 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:58.310262 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-233d8f60-a659-498a-bdf3-37142d7d5e90 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:58.310693 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-233d8f60-a659-498a-bdf3-37142d7d5e90 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:58.311387 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-233d8f60-a659-498a-bdf3-37142d7d5e90 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:58.311835 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-233d8f60-a659-498a-bdf3-37142d7d5e90 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:58.312254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-233d8f60-a659-498a-bdf3-37142d7d5e90 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:58.459162 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-233d8f60-a659-498a-bdf3-37142d7d5e90 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:58.472302 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-233d8f60-a659-498a-bdf3-37142d7d5e90 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:58.474666 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-233d8f60-a659-498a-bdf3-37142d7d5e90 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:58.476568 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-233d8f60-a659-498a-bdf3-37142d7d5e90 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1752 microversion: 2.20 time: 0.178160 Aug 31 00:37:58.477422 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 199/409] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:58 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:37:59.503153 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d8e5dedc-82f2-4c7f-af45-602b1ea81dd0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:37:59.503893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d8e5dedc-82f2-4c7f-af45-602b1ea81dd0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:37:59.515473 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8e5dedc-82f2-4c7f-af45-602b1ea81dd0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.515473 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8e5dedc-82f2-4c7f-af45-602b1ea81dd0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.515473 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8e5dedc-82f2-4c7f-af45-602b1ea81dd0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.515473 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8e5dedc-82f2-4c7f-af45-602b1ea81dd0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:37:59.517757 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8e5dedc-82f2-4c7f-af45-602b1ea81dd0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:37:59.517757 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8e5dedc-82f2-4c7f-af45-602b1ea81dd0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:37:59.651688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d8e5dedc-82f2-4c7f-af45-602b1ea81dd0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:59.660456 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d8e5dedc-82f2-4c7f-af45-602b1ea81dd0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:59.661902 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d8e5dedc-82f2-4c7f-af45-602b1ea81dd0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:37:59.663189 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d8e5dedc-82f2-4c7f-af45-602b1ea81dd0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.163924 Aug 31 00:37:59.663738 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 211/410] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:37:59 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:38:00.686761 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-4947fb5a-e887-4d38-ade2-9f25a27cced9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:00.687360 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-4947fb5a-e887-4d38-ade2-9f25a27cced9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:00.693413 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4947fb5a-e887-4d38-ade2-9f25a27cced9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.693894 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4947fb5a-e887-4d38-ade2-9f25a27cced9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.694449 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4947fb5a-e887-4d38-ade2-9f25a27cced9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.695633 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4947fb5a-e887-4d38-ade2-9f25a27cced9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:00.696152 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4947fb5a-e887-4d38-ade2-9f25a27cced9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:00.696668 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4947fb5a-e887-4d38-ade2-9f25a27cced9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:00.835071 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4947fb5a-e887-4d38-ade2-9f25a27cced9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:00.844829 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4947fb5a-e887-4d38-ade2-9f25a27cced9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:00.846256 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4947fb5a-e887-4d38-ade2-9f25a27cced9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:00.847480 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-4947fb5a-e887-4d38-ade2-9f25a27cced9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.164642 Aug 31 00:38:00.848099 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 200/411] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:00 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:38:01.871756 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-60c46e5a-bf63-4d1a-bf92-c7a7e5a8263a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:01.872303 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-60c46e5a-bf63-4d1a-bf92-c7a7e5a8263a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:01.878766 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-60c46e5a-bf63-4d1a-bf92-c7a7e5a8263a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:01.879240 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-60c46e5a-bf63-4d1a-bf92-c7a7e5a8263a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:01.879665 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-60c46e5a-bf63-4d1a-bf92-c7a7e5a8263a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:01.881039 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-60c46e5a-bf63-4d1a-bf92-c7a7e5a8263a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:01.881039 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-60c46e5a-bf63-4d1a-bf92-c7a7e5a8263a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:01.881301 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-60c46e5a-bf63-4d1a-bf92-c7a7e5a8263a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:02.044917 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-60c46e5a-bf63-4d1a-bf92-c7a7e5a8263a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:02.060399 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-60c46e5a-bf63-4d1a-bf92-c7a7e5a8263a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:02.061849 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-60c46e5a-bf63-4d1a-bf92-c7a7e5a8263a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:02.063026 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-60c46e5a-bf63-4d1a-bf92-c7a7e5a8263a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.195774 Aug 31 00:38:02.065015 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 212/412] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:01 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:38:02.372750 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-4955e20d-2d80-447f-8ab4-ba72c3903261 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:02.374008 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-4955e20d-2d80-447f-8ab4-ba72c3903261 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:02.381217 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4955e20d-2d80-447f-8ab4-ba72c3903261 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:02.382064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4955e20d-2d80-447f-8ab4-ba72c3903261 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:02.383042 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4955e20d-2d80-447f-8ab4-ba72c3903261 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:02.384129 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4955e20d-2d80-447f-8ab4-ba72c3903261 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:02.384877 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4955e20d-2d80-447f-8ab4-ba72c3903261 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:02.385541 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4955e20d-2d80-447f-8ab4-ba72c3903261 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:02.412815 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-4955e20d-2d80-447f-8ab4-ba72c3903261 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf/ips" status: 200 len: 144 microversion: 2.1 time: 0.043948 Aug 31 00:38:02.414536 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 201/413] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 00:38:02 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf/ips => generated 144 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:03.089499 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-167de600-69fe-47e4-ad3b-bd2c461a00f6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:03.090108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-167de600-69fe-47e4-ad3b-bd2c461a00f6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:03.097456 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-167de600-69fe-47e4-ad3b-bd2c461a00f6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:03.097945 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-167de600-69fe-47e4-ad3b-bd2c461a00f6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:03.098382 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-167de600-69fe-47e4-ad3b-bd2c461a00f6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:03.099080 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-167de600-69fe-47e4-ad3b-bd2c461a00f6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:03.099524 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-167de600-69fe-47e4-ad3b-bd2c461a00f6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:03.099948 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-167de600-69fe-47e4-ad3b-bd2c461a00f6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:03.254912 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-167de600-69fe-47e4-ad3b-bd2c461a00f6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:03.265596 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-167de600-69fe-47e4-ad3b-bd2c461a00f6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:03.267310 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-167de600-69fe-47e4-ad3b-bd2c461a00f6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:03.268678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-167de600-69fe-47e4-ad3b-bd2c461a00f6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.184090 Aug 31 00:38:03.276944 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 213/414] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:03 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:38:04.294924 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-760c7c02-25a3-4b14-b8b3-8b2fec7a2b57 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:04.295767 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-760c7c02-25a3-4b14-b8b3-8b2fec7a2b57 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:04.302579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-760c7c02-25a3-4b14-b8b3-8b2fec7a2b57 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:04.303049 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-760c7c02-25a3-4b14-b8b3-8b2fec7a2b57 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:04.303473 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-760c7c02-25a3-4b14-b8b3-8b2fec7a2b57 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:04.304978 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-760c7c02-25a3-4b14-b8b3-8b2fec7a2b57 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:04.305410 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-760c7c02-25a3-4b14-b8b3-8b2fec7a2b57 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:04.305814 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-760c7c02-25a3-4b14-b8b3-8b2fec7a2b57 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:04.467605 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-760c7c02-25a3-4b14-b8b3-8b2fec7a2b57 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:04.475370 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-760c7c02-25a3-4b14-b8b3-8b2fec7a2b57 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:04.477691 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-760c7c02-25a3-4b14-b8b3-8b2fec7a2b57 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:04.484651 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-760c7c02-25a3-4b14-b8b3-8b2fec7a2b57 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.194606 Aug 31 00:38:04.504306 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 202/415] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:04 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:38:05.512453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-679d6ca8-e720-4f9a-bd22-e00f6aff08f5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:05.513312 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-679d6ca8-e720-4f9a-bd22-e00f6aff08f5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:05.521265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-679d6ca8-e720-4f9a-bd22-e00f6aff08f5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:05.521984 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-679d6ca8-e720-4f9a-bd22-e00f6aff08f5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:05.522562 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-679d6ca8-e720-4f9a-bd22-e00f6aff08f5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:05.524739 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-679d6ca8-e720-4f9a-bd22-e00f6aff08f5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:05.524861 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-679d6ca8-e720-4f9a-bd22-e00f6aff08f5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:05.525441 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-679d6ca8-e720-4f9a-bd22-e00f6aff08f5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:05.687031 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-679d6ca8-e720-4f9a-bd22-e00f6aff08f5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:05.696010 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-679d6ca8-e720-4f9a-bd22-e00f6aff08f5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:05.697604 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-679d6ca8-e720-4f9a-bd22-e00f6aff08f5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:05.698766 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-679d6ca8-e720-4f9a-bd22-e00f6aff08f5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.192263 Aug 31 00:38:05.699369 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 214/416] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:05 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:38:06.722018 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-bc8feb5d-ae80-4263-8103-8f99991e3e1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:06.722658 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-bc8feb5d-ae80-4263-8103-8f99991e3e1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:06.729601 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bc8feb5d-ae80-4263-8103-8f99991e3e1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:06.730089 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bc8feb5d-ae80-4263-8103-8f99991e3e1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:06.730521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bc8feb5d-ae80-4263-8103-8f99991e3e1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:06.731233 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bc8feb5d-ae80-4263-8103-8f99991e3e1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:06.731683 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bc8feb5d-ae80-4263-8103-8f99991e3e1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:06.732106 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bc8feb5d-ae80-4263-8103-8f99991e3e1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:07.123353 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-bc8feb5d-ae80-4263-8103-8f99991e3e1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:07.132482 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-bc8feb5d-ae80-4263-8103-8f99991e3e1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:07.134114 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-bc8feb5d-ae80-4263-8103-8f99991e3e1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:07.135272 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-bc8feb5d-ae80-4263-8103-8f99991e3e1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.417344 Aug 31 00:38:07.135817 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 203/417] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:06 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:38:07.541927 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-63f4663d-215a-4c3a-8def-4e17db272a47 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4543f79f-d195-43ac-abf5-c4d12b800e6e"}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:38:07.544479 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-63f4663d-215a-4c3a-8def-4e17db272a47 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:07.551336 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-63f4663d-215a-4c3a-8def-4e17db272a47 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:07.551825 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-63f4663d-215a-4c3a-8def-4e17db272a47 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:07.552262 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-63f4663d-215a-4c3a-8def-4e17db272a47 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:07.552995 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-63f4663d-215a-4c3a-8def-4e17db272a47 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:07.553457 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-63f4663d-215a-4c3a-8def-4e17db272a47 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:07.553874 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-63f4663d-215a-4c3a-8def-4e17db272a47 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:08.159653 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-fabbd4ae-a5c5-487a-bafe-a24b9c6ea8d4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:08.160248 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-fabbd4ae-a5c5-487a-bafe-a24b9c6ea8d4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:08.167402 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fabbd4ae-a5c5-487a-bafe-a24b9c6ea8d4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:08.167886 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fabbd4ae-a5c5-487a-bafe-a24b9c6ea8d4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:08.168358 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fabbd4ae-a5c5-487a-bafe-a24b9c6ea8d4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:08.169057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fabbd4ae-a5c5-487a-bafe-a24b9c6ea8d4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:08.169502 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fabbd4ae-a5c5-487a-bafe-a24b9c6ea8d4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:08.169921 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fabbd4ae-a5c5-487a-bafe-a24b9c6ea8d4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:08.317189 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fabbd4ae-a5c5-487a-bafe-a24b9c6ea8d4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:08.326410 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fabbd4ae-a5c5-487a-bafe-a24b9c6ea8d4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:08.327896 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fabbd4ae-a5c5-487a-bafe-a24b9c6ea8d4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:08.329091 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-fabbd4ae-a5c5-487a-bafe-a24b9c6ea8d4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.173536 Aug 31 00:38:08.329642 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 204/418] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:08 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:38:09.352426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-783e7d5b-0734-4e24-998d-00c8ccfe9563 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:09.353120 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-783e7d5b-0734-4e24-998d-00c8ccfe9563 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:09.359545 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-783e7d5b-0734-4e24-998d-00c8ccfe9563 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:09.360342 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-783e7d5b-0734-4e24-998d-00c8ccfe9563 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:09.360951 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-783e7d5b-0734-4e24-998d-00c8ccfe9563 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:09.361850 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-783e7d5b-0734-4e24-998d-00c8ccfe9563 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:09.362459 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-783e7d5b-0734-4e24-998d-00c8ccfe9563 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:09.363046 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-783e7d5b-0734-4e24-998d-00c8ccfe9563 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:09.543014 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-783e7d5b-0734-4e24-998d-00c8ccfe9563 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:09.555401 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-783e7d5b-0734-4e24-998d-00c8ccfe9563 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:09.556988 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-783e7d5b-0734-4e24-998d-00c8ccfe9563 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:09.558152 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-783e7d5b-0734-4e24-998d-00c8ccfe9563 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.209906 Aug 31 00:38:09.558906 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 205/419] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:09 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:38:10.586533 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-3e226dc1-7df8-4f64-a28f-df3cfc1a3d93 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:10.588234 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-3e226dc1-7df8-4f64-a28f-df3cfc1a3d93 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:10.594863 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3e226dc1-7df8-4f64-a28f-df3cfc1a3d93 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:10.595360 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3e226dc1-7df8-4f64-a28f-df3cfc1a3d93 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:10.595793 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3e226dc1-7df8-4f64-a28f-df3cfc1a3d93 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:10.596510 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3e226dc1-7df8-4f64-a28f-df3cfc1a3d93 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:10.596975 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3e226dc1-7df8-4f64-a28f-df3cfc1a3d93 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:10.597371 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3e226dc1-7df8-4f64-a28f-df3cfc1a3d93 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:10.748511 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-3e226dc1-7df8-4f64-a28f-df3cfc1a3d93 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:10.759230 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-3e226dc1-7df8-4f64-a28f-df3cfc1a3d93 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:10.761238 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-3e226dc1-7df8-4f64-a28f-df3cfc1a3d93 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:10.762644 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-3e226dc1-7df8-4f64-a28f-df3cfc1a3d93 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.180745 Aug 31 00:38:10.776734 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 206/420] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:10 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:38:11.788268 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d9d72230-a015-4823-ae2a-aaaa28c0c84c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:11.789040 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d9d72230-a015-4823-ae2a-aaaa28c0c84c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:11.796275 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9d72230-a015-4823-ae2a-aaaa28c0c84c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:11.796787 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9d72230-a015-4823-ae2a-aaaa28c0c84c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:11.797223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9d72230-a015-4823-ae2a-aaaa28c0c84c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:11.797932 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9d72230-a015-4823-ae2a-aaaa28c0c84c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:11.798398 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9d72230-a015-4823-ae2a-aaaa28c0c84c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:11.798820 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9d72230-a015-4823-ae2a-aaaa28c0c84c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:11.960823 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d9d72230-a015-4823-ae2a-aaaa28c0c84c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:11.970418 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d9d72230-a015-4823-ae2a-aaaa28c0c84c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:11.971863 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d9d72230-a015-4823-ae2a-aaaa28c0c84c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:11.973188 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d9d72230-a015-4823-ae2a-aaaa28c0c84c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.188800 Aug 31 00:38:11.973741 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 207/421] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:11 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:38:12.997037 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-8c3489a2-7240-412a-9b43-fe043faea121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:12.998003 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-8c3489a2-7240-412a-9b43-fe043faea121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:13.004047 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8c3489a2-7240-412a-9b43-fe043faea121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:13.004867 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8c3489a2-7240-412a-9b43-fe043faea121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:13.005505 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8c3489a2-7240-412a-9b43-fe043faea121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:13.006216 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8c3489a2-7240-412a-9b43-fe043faea121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:13.006661 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8c3489a2-7240-412a-9b43-fe043faea121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:13.007136 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8c3489a2-7240-412a-9b43-fe043faea121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:13.148704 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-8c3489a2-7240-412a-9b43-fe043faea121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:13.157542 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-8c3489a2-7240-412a-9b43-fe043faea121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:13.158987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-8c3489a2-7240-412a-9b43-fe043faea121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:13.160159 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-8c3489a2-7240-412a-9b43-fe043faea121 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.167625 Aug 31 00:38:13.160731 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 208/422] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:12 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:38:14.185174 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c887df71-6f54-421d-a4e2-02eba00f84fe tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:14.185807 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c887df71-6f54-421d-a4e2-02eba00f84fe tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:14.191698 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c887df71-6f54-421d-a4e2-02eba00f84fe tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:14.192169 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c887df71-6f54-421d-a4e2-02eba00f84fe tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:14.192626 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c887df71-6f54-421d-a4e2-02eba00f84fe tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:14.193398 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c887df71-6f54-421d-a4e2-02eba00f84fe tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:14.193744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c887df71-6f54-421d-a4e2-02eba00f84fe tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:14.194159 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c887df71-6f54-421d-a4e2-02eba00f84fe tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:14.323193 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c887df71-6f54-421d-a4e2-02eba00f84fe tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:14.332226 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c887df71-6f54-421d-a4e2-02eba00f84fe tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:14.333684 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c887df71-6f54-421d-a4e2-02eba00f84fe tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:14.334825 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-c887df71-6f54-421d-a4e2-02eba00f84fe tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.154330 Aug 31 00:38:14.335444 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 209/423] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:14 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:38:15.358787 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-bbbd39c4-acaa-45e5-9f51-177de75db6af tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:15.359475 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-bbbd39c4-acaa-45e5-9f51-177de75db6af tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:15.365486 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bbbd39c4-acaa-45e5-9f51-177de75db6af tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:15.365966 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bbbd39c4-acaa-45e5-9f51-177de75db6af tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:15.366903 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bbbd39c4-acaa-45e5-9f51-177de75db6af tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:15.367062 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bbbd39c4-acaa-45e5-9f51-177de75db6af tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:15.367511 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bbbd39c4-acaa-45e5-9f51-177de75db6af tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:15.367929 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bbbd39c4-acaa-45e5-9f51-177de75db6af tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:15.506544 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-bbbd39c4-acaa-45e5-9f51-177de75db6af tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:15.515958 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-bbbd39c4-acaa-45e5-9f51-177de75db6af tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:15.517428 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-bbbd39c4-acaa-45e5-9f51-177de75db6af tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:15.518570 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-bbbd39c4-acaa-45e5-9f51-177de75db6af tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.164029 Aug 31 00:38:15.519127 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 210/424] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:15 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:38:15.818108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-63f4663d-215a-4c3a-8def-4e17db272a47 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "POST /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.279793 Aug 31 00:38:15.818745 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 215/425] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 00:38:07 2022] POST /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf/os-volume_attachments => generated 194 bytes in 8282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:16.542080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-4359411d-e499-4184-b6eb-d3cfc33f3a9e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:16.542708 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-4359411d-e499-4184-b6eb-d3cfc33f3a9e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:16.548770 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4359411d-e499-4184-b6eb-d3cfc33f3a9e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:16.549243 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4359411d-e499-4184-b6eb-d3cfc33f3a9e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:16.549672 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4359411d-e499-4184-b6eb-d3cfc33f3a9e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:16.550345 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4359411d-e499-4184-b6eb-d3cfc33f3a9e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:16.550787 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4359411d-e499-4184-b6eb-d3cfc33f3a9e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:16.551197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4359411d-e499-4184-b6eb-d3cfc33f3a9e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:16.566064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:16.683194 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4359411d-e499-4184-b6eb-d3cfc33f3a9e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:16.691889 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4359411d-e499-4184-b6eb-d3cfc33f3a9e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:16.693378 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4359411d-e499-4184-b6eb-d3cfc33f3a9e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:16.694596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-4359411d-e499-4184-b6eb-d3cfc33f3a9e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.156586 Aug 31 00:38:16.695084 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 211/426] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:16 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:38:17.719376 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-dc9f9755-92e9-46c0-a2d2-1167f98f4e28 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:17.719987 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-dc9f9755-92e9-46c0-a2d2-1167f98f4e28 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:17.722474 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=19 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:17.727403 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dc9f9755-92e9-46c0-a2d2-1167f98f4e28 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:17.727883 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dc9f9755-92e9-46c0-a2d2-1167f98f4e28 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:17.728343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dc9f9755-92e9-46c0-a2d2-1167f98f4e28 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:17.729065 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dc9f9755-92e9-46c0-a2d2-1167f98f4e28 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:17.745603 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dc9f9755-92e9-46c0-a2d2-1167f98f4e28 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:17.745603 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dc9f9755-92e9-46c0-a2d2-1167f98f4e28 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:17.860621 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-dc9f9755-92e9-46c0-a2d2-1167f98f4e28 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:17.869296 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-dc9f9755-92e9-46c0-a2d2-1167f98f4e28 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:17.871350 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-dc9f9755-92e9-46c0-a2d2-1167f98f4e28 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:17.872616 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-dc9f9755-92e9-46c0-a2d2-1167f98f4e28 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.157533 Aug 31 00:38:17.873174 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 216/427] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:17 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:38:18.896262 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-1ec94851-8ece-4885-9a39-8ca897e315eb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:18.896895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-1ec94851-8ece-4885-9a39-8ca897e315eb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:18.903718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1ec94851-8ece-4885-9a39-8ca897e315eb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:18.904194 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1ec94851-8ece-4885-9a39-8ca897e315eb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:18.904661 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1ec94851-8ece-4885-9a39-8ca897e315eb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:18.905349 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1ec94851-8ece-4885-9a39-8ca897e315eb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:18.905886 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1ec94851-8ece-4885-9a39-8ca897e315eb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:18.906309 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1ec94851-8ece-4885-9a39-8ca897e315eb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:19.037307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-1ec94851-8ece-4885-9a39-8ca897e315eb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:19.046204 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-1ec94851-8ece-4885-9a39-8ca897e315eb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:19.047684 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-1ec94851-8ece-4885-9a39-8ca897e315eb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:19.048892 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-1ec94851-8ece-4885-9a39-8ca897e315eb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.156663 Aug 31 00:38:19.049437 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 212/428] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:18 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:38:20.072476 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-910b6d6e-5405-4d9c-8234-d3dc26af0cc3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:20.082890 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-910b6d6e-5405-4d9c-8234-d3dc26af0cc3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:20.082890 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-910b6d6e-5405-4d9c-8234-d3dc26af0cc3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:20.082890 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-910b6d6e-5405-4d9c-8234-d3dc26af0cc3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:20.082890 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-910b6d6e-5405-4d9c-8234-d3dc26af0cc3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:20.083293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-910b6d6e-5405-4d9c-8234-d3dc26af0cc3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:20.083293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-910b6d6e-5405-4d9c-8234-d3dc26af0cc3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:20.083293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-910b6d6e-5405-4d9c-8234-d3dc26af0cc3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:20.218276 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-910b6d6e-5405-4d9c-8234-d3dc26af0cc3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:20.226794 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-910b6d6e-5405-4d9c-8234-d3dc26af0cc3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:20.228203 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-910b6d6e-5405-4d9c-8234-d3dc26af0cc3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:20.229369 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-910b6d6e-5405-4d9c-8234-d3dc26af0cc3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.160922 Aug 31 00:38:20.229982 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 217/429] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:20 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:38:21.252592 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-70eaaf92-f5ee-406d-9df8-0fd899a74004 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:21.253194 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-70eaaf92-f5ee-406d-9df8-0fd899a74004 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:21.259158 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70eaaf92-f5ee-406d-9df8-0fd899a74004 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:21.259634 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70eaaf92-f5ee-406d-9df8-0fd899a74004 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:21.260063 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70eaaf92-f5ee-406d-9df8-0fd899a74004 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:21.260773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70eaaf92-f5ee-406d-9df8-0fd899a74004 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:21.261221 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70eaaf92-f5ee-406d-9df8-0fd899a74004 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:21.261724 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70eaaf92-f5ee-406d-9df8-0fd899a74004 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:21.392085 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-70eaaf92-f5ee-406d-9df8-0fd899a74004 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:21.400279 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-70eaaf92-f5ee-406d-9df8-0fd899a74004 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:21.401782 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-70eaaf92-f5ee-406d-9df8-0fd899a74004 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:21.403685 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-70eaaf92-f5ee-406d-9df8-0fd899a74004 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.154983 Aug 31 00:38:21.404246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 213/430] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:21 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:38:22.427895 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-149e655a-adbb-4feb-a868-dbb4874c1a77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:22.428510 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-149e655a-adbb-4feb-a868-dbb4874c1a77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:22.436104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-149e655a-adbb-4feb-a868-dbb4874c1a77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:22.436619 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-149e655a-adbb-4feb-a868-dbb4874c1a77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:22.437051 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-149e655a-adbb-4feb-a868-dbb4874c1a77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:22.437749 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-149e655a-adbb-4feb-a868-dbb4874c1a77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:22.438200 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-149e655a-adbb-4feb-a868-dbb4874c1a77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:22.438769 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-149e655a-adbb-4feb-a868-dbb4874c1a77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:22.568654 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-149e655a-adbb-4feb-a868-dbb4874c1a77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:22.577397 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-149e655a-adbb-4feb-a868-dbb4874c1a77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:22.578841 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-149e655a-adbb-4feb-a868-dbb4874c1a77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:22.579991 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-149e655a-adbb-4feb-a868-dbb4874c1a77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.156171 Aug 31 00:38:22.580584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 218/431] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:22 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:38:23.603276 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-b76b1839-3ee2-4c8e-9048-4502849d9e49 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:23.603878 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-b76b1839-3ee2-4c8e-9048-4502849d9e49 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:23.610704 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b76b1839-3ee2-4c8e-9048-4502849d9e49 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:23.613507 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b76b1839-3ee2-4c8e-9048-4502849d9e49 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:23.613507 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b76b1839-3ee2-4c8e-9048-4502849d9e49 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:23.613507 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b76b1839-3ee2-4c8e-9048-4502849d9e49 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:23.613507 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b76b1839-3ee2-4c8e-9048-4502849d9e49 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:23.613881 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b76b1839-3ee2-4c8e-9048-4502849d9e49 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:23.746101 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b76b1839-3ee2-4c8e-9048-4502849d9e49 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:23.754751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b76b1839-3ee2-4c8e-9048-4502849d9e49 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:23.756191 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b76b1839-3ee2-4c8e-9048-4502849d9e49 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:23.757376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-b76b1839-3ee2-4c8e-9048-4502849d9e49 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.158060 Aug 31 00:38:23.757929 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 214/432] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:23 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:38:24.416005 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-2e0260f8-acbe-4ede-bbe8-6cb47f172cdf tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:38:24.422854 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2e0260f8-acbe-4ede-bbe8-6cb47f172cdf tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:24.423339 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2e0260f8-acbe-4ede-bbe8-6cb47f172cdf tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:24.423773 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2e0260f8-acbe-4ede-bbe8-6cb47f172cdf tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:24.487607 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-2e0260f8-acbe-4ede-bbe8-6cb47f172cdf tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Going to try to stop instance {{(pid=128049) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 00:38:24.617119 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-2e0260f8-acbe-4ede-bbe8-6cb47f172cdf tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "POST /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf/action" status: 202 len: 0 microversion: 2.1 time: 0.204643 Aug 31 00:38:24.617712 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 219/433] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 00:38:24 2022] POST /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:38:24.626469 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-3851890c-7d50-4e92-824c-4fc3bd71a6aa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:24.627090 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-3851890c-7d50-4e92-824c-4fc3bd71a6aa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:24.633886 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3851890c-7d50-4e92-824c-4fc3bd71a6aa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:24.634421 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3851890c-7d50-4e92-824c-4fc3bd71a6aa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:24.634854 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3851890c-7d50-4e92-824c-4fc3bd71a6aa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:24.635595 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3851890c-7d50-4e92-824c-4fc3bd71a6aa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:24.636044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3851890c-7d50-4e92-824c-4fc3bd71a6aa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:24.636495 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3851890c-7d50-4e92-824c-4fc3bd71a6aa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:24.771603 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-3851890c-7d50-4e92-824c-4fc3bd71a6aa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:24.780313 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-3851890c-7d50-4e92-824c-4fc3bd71a6aa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1720 microversion: 2.1 time: 0.158234 Aug 31 00:38:24.780896 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 215/434] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:24 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:24.782122 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a82e449c-5c19-4eac-b967-7097b09c405d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:24.782815 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a82e449c-5c19-4eac-b967-7097b09c405d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:24.789191 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a82e449c-5c19-4eac-b967-7097b09c405d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:24.789681 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a82e449c-5c19-4eac-b967-7097b09c405d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:24.790122 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a82e449c-5c19-4eac-b967-7097b09c405d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:24.790850 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a82e449c-5c19-4eac-b967-7097b09c405d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:24.791299 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a82e449c-5c19-4eac-b967-7097b09c405d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:24.791723 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a82e449c-5c19-4eac-b967-7097b09c405d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:24.928156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a82e449c-5c19-4eac-b967-7097b09c405d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:24.937063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a82e449c-5c19-4eac-b967-7097b09c405d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:24.938476 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a82e449c-5c19-4eac-b967-7097b09c405d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:24.939692 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a82e449c-5c19-4eac-b967-7097b09c405d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.162194 Aug 31 00:38:24.940249 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 220/435] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:24 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:38:25.471849 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-c46a5bd0-a7e5-45bf-b59f-0275f5a3af67 req-99469a8a-8fcd-48d6-994c-d79f9528ce9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc3d686-f358-4b8f-b983-984fd54e31e1", "name": "network-vif-plugged", "status": "completed", "tag": "e469ed11-88fc-4e04-ad53-fa40c91854d5"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:38:25.481482 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-c46a5bd0-a7e5-45bf-b59f-0275f5a3af67 req-99469a8a-8fcd-48d6-994c-d79f9528ce9a service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:25.481964 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-c46a5bd0-a7e5-45bf-b59f-0275f5a3af67 req-99469a8a-8fcd-48d6-994c-d79f9528ce9a service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:25.482410 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-c46a5bd0-a7e5-45bf-b59f-0275f5a3af67 req-99469a8a-8fcd-48d6-994c-d79f9528ce9a service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:25.496033 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-c46a5bd0-a7e5-45bf-b59f-0275f5a3af67 req-99469a8a-8fcd-48d6-994c-d79f9528ce9a service nova] Creating event network-vif-plugged:e469ed11-88fc-4e04-ad53-fa40c91854d5 for instance dfc3d686-f358-4b8f-b983-984fd54e31e1 on hv-cinder-85221 Aug 31 00:38:25.501906 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-c46a5bd0-a7e5-45bf-b59f-0275f5a3af67 req-99469a8a-8fcd-48d6-994c-d79f9528ce9a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033969 Aug 31 00:38:25.502497 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 216/436] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:25.801918 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8472cba4-87f3-494e-9231-ed42f9434d31 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:25.802531 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8472cba4-87f3-494e-9231-ed42f9434d31 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:25.808921 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8472cba4-87f3-494e-9231-ed42f9434d31 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:25.809391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8472cba4-87f3-494e-9231-ed42f9434d31 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:25.809818 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8472cba4-87f3-494e-9231-ed42f9434d31 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:25.810489 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8472cba4-87f3-494e-9231-ed42f9434d31 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:25.810927 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8472cba4-87f3-494e-9231-ed42f9434d31 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:25.811341 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8472cba4-87f3-494e-9231-ed42f9434d31 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:25.942255 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8472cba4-87f3-494e-9231-ed42f9434d31 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:25.950326 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8472cba4-87f3-494e-9231-ed42f9434d31 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1720 microversion: 2.1 time: 0.152292 Aug 31 00:38:25.950908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 221/437] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:25 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:25.963517 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d9b84228-9d02-436b-a258-aef488c79bb3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:25.964262 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d9b84228-9d02-436b-a258-aef488c79bb3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:25.971694 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9b84228-9d02-436b-a258-aef488c79bb3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:25.972174 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9b84228-9d02-436b-a258-aef488c79bb3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:25.972697 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9b84228-9d02-436b-a258-aef488c79bb3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:25.973385 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9b84228-9d02-436b-a258-aef488c79bb3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:25.973849 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9b84228-9d02-436b-a258-aef488c79bb3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:25.974261 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9b84228-9d02-436b-a258-aef488c79bb3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:26.104299 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d9b84228-9d02-436b-a258-aef488c79bb3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:26.113425 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d9b84228-9d02-436b-a258-aef488c79bb3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:26.114859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d9b84228-9d02-436b-a258-aef488c79bb3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:26.116005 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d9b84228-9d02-436b-a258-aef488c79bb3 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.156843 Aug 31 00:38:26.116580 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 217/438] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:25 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:38:26.972148 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ce16c889-816f-4f10-b95c-d442414fb218 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:26.972827 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ce16c889-816f-4f10-b95c-d442414fb218 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:26.979252 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ce16c889-816f-4f10-b95c-d442414fb218 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:26.979730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ce16c889-816f-4f10-b95c-d442414fb218 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:26.980163 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ce16c889-816f-4f10-b95c-d442414fb218 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:26.980878 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ce16c889-816f-4f10-b95c-d442414fb218 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:26.981330 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ce16c889-816f-4f10-b95c-d442414fb218 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:26.981755 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ce16c889-816f-4f10-b95c-d442414fb218 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:27.111581 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ce16c889-816f-4f10-b95c-d442414fb218 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:27.119918 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ce16c889-816f-4f10-b95c-d442414fb218 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1720 microversion: 2.1 time: 0.152208 Aug 31 00:38:27.120515 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 222/439] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:26 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:27.139568 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-8a0bdaec-b164-430a-a0a1-ace919d7244b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:27.140171 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-8a0bdaec-b164-430a-a0a1-ace919d7244b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:27.146106 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8a0bdaec-b164-430a-a0a1-ace919d7244b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:27.146587 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8a0bdaec-b164-430a-a0a1-ace919d7244b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:27.147015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8a0bdaec-b164-430a-a0a1-ace919d7244b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:27.147698 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8a0bdaec-b164-430a-a0a1-ace919d7244b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:27.148145 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8a0bdaec-b164-430a-a0a1-ace919d7244b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:27.148865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8a0bdaec-b164-430a-a0a1-ace919d7244b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:27.281080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-8a0bdaec-b164-430a-a0a1-ace919d7244b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:27.289548 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-8a0bdaec-b164-430a-a0a1-ace919d7244b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:27.290977 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-8a0bdaec-b164-430a-a0a1-ace919d7244b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:27.292121 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-8a0bdaec-b164-430a-a0a1-ace919d7244b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.157090 Aug 31 00:38:27.292708 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 218/440] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:27 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:38:28.142740 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f1c542bc-03e9-4ccf-abde-b5e63449681f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:28.143351 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f1c542bc-03e9-4ccf-abde-b5e63449681f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:28.150369 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f1c542bc-03e9-4ccf-abde-b5e63449681f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:28.150717 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f1c542bc-03e9-4ccf-abde-b5e63449681f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:28.151149 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f1c542bc-03e9-4ccf-abde-b5e63449681f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:28.152257 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f1c542bc-03e9-4ccf-abde-b5e63449681f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:28.152489 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f1c542bc-03e9-4ccf-abde-b5e63449681f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:28.152738 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f1c542bc-03e9-4ccf-abde-b5e63449681f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:28.157881 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:28.288281 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f1c542bc-03e9-4ccf-abde-b5e63449681f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:28.297319 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f1c542bc-03e9-4ccf-abde-b5e63449681f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1720 microversion: 2.1 time: 0.159315 Aug 31 00:38:28.297891 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 223/441] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:28 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:28.315214 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-61badc36-dd59-45f0-9f24-43f1b8b98bb6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:28.315821 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-61badc36-dd59-45f0-9f24-43f1b8b98bb6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:28.321869 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-61badc36-dd59-45f0-9f24-43f1b8b98bb6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:28.322339 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-61badc36-dd59-45f0-9f24-43f1b8b98bb6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:28.322762 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-61badc36-dd59-45f0-9f24-43f1b8b98bb6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:28.323435 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-61badc36-dd59-45f0-9f24-43f1b8b98bb6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:28.323875 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-61badc36-dd59-45f0-9f24-43f1b8b98bb6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:28.324285 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-61badc36-dd59-45f0-9f24-43f1b8b98bb6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:28.462322 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-61badc36-dd59-45f0-9f24-43f1b8b98bb6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:28.472297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-61badc36-dd59-45f0-9f24-43f1b8b98bb6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:28.473822 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-61badc36-dd59-45f0-9f24-43f1b8b98bb6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:28.475031 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-61badc36-dd59-45f0-9f24-43f1b8b98bb6 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1808 microversion: 2.20 time: 0.163949 Aug 31 00:38:28.475583 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 219/442] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:28 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:38:29.318412 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6f5b52fe-1cdf-444c-a9f1-30704b6b2eda tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:29.319034 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6f5b52fe-1cdf-444c-a9f1-30704b6b2eda tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:29.325859 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f5b52fe-1cdf-444c-a9f1-30704b6b2eda tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:29.326340 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f5b52fe-1cdf-444c-a9f1-30704b6b2eda tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:29.326778 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f5b52fe-1cdf-444c-a9f1-30704b6b2eda tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:29.328078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f5b52fe-1cdf-444c-a9f1-30704b6b2eda tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:29.329012 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f5b52fe-1cdf-444c-a9f1-30704b6b2eda tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:29.329435 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f5b52fe-1cdf-444c-a9f1-30704b6b2eda tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:29.468318 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6f5b52fe-1cdf-444c-a9f1-30704b6b2eda tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:29.476746 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6f5b52fe-1cdf-444c-a9f1-30704b6b2eda tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1720 microversion: 2.1 time: 0.162198 Aug 31 00:38:29.477311 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 224/443] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:29 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:29.498375 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-261673c3-b9dc-48a1-94a6-6ead4194f47b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:29.501993 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-261673c3-b9dc-48a1-94a6-6ead4194f47b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:29.501993 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=42 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:29.506424 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-261673c3-b9dc-48a1-94a6-6ead4194f47b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:29.506901 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-261673c3-b9dc-48a1-94a6-6ead4194f47b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:29.507333 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-261673c3-b9dc-48a1-94a6-6ead4194f47b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:29.508016 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-261673c3-b9dc-48a1-94a6-6ead4194f47b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:29.508518 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-261673c3-b9dc-48a1-94a6-6ead4194f47b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:29.508938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-261673c3-b9dc-48a1-94a6-6ead4194f47b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:29.639550 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-261673c3-b9dc-48a1-94a6-6ead4194f47b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:29.649241 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-261673c3-b9dc-48a1-94a6-6ead4194f47b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:29.650691 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-261673c3-b9dc-48a1-94a6-6ead4194f47b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:29.651845 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-261673c3-b9dc-48a1-94a6-6ead4194f47b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1795 microversion: 2.20 time: 0.157467 Aug 31 00:38:29.652418 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 220/444] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:38:29 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1795 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:38:30.498540 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-986a8e63-d852-4ce7-ab05-e35bbf4099ac tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:30.499145 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-986a8e63-d852-4ce7-ab05-e35bbf4099ac tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:30.506428 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-986a8e63-d852-4ce7-ab05-e35bbf4099ac tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:30.506899 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-986a8e63-d852-4ce7-ab05-e35bbf4099ac tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:30.507325 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-986a8e63-d852-4ce7-ab05-e35bbf4099ac tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:30.508030 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-986a8e63-d852-4ce7-ab05-e35bbf4099ac tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:30.508515 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-986a8e63-d852-4ce7-ab05-e35bbf4099ac tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:30.508963 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-986a8e63-d852-4ce7-ab05-e35bbf4099ac tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:30.642843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-986a8e63-d852-4ce7-ab05-e35bbf4099ac tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:30.651302 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-986a8e63-d852-4ce7-ab05-e35bbf4099ac tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1720 microversion: 2.1 time: 0.156653 Aug 31 00:38:30.651863 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 225/445] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:30 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:31.672621 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-0e6a4a23-9093-4fb7-b15b-6db949d7fcdb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:31.673221 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-0e6a4a23-9093-4fb7-b15b-6db949d7fcdb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:31.679232 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0e6a4a23-9093-4fb7-b15b-6db949d7fcdb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:31.679709 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0e6a4a23-9093-4fb7-b15b-6db949d7fcdb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:31.680138 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0e6a4a23-9093-4fb7-b15b-6db949d7fcdb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:31.680854 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0e6a4a23-9093-4fb7-b15b-6db949d7fcdb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:31.681303 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0e6a4a23-9093-4fb7-b15b-6db949d7fcdb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:31.681718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0e6a4a23-9093-4fb7-b15b-6db949d7fcdb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:31.812072 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0e6a4a23-9093-4fb7-b15b-6db949d7fcdb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:31.820747 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-0e6a4a23-9093-4fb7-b15b-6db949d7fcdb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1720 microversion: 2.1 time: 0.151989 Aug 31 00:38:31.821312 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 221/446] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:31 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:32.842262 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a237620e-b95d-4aa6-8adb-a75275eca36d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:32.842868 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a237620e-b95d-4aa6-8adb-a75275eca36d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:32.849949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a237620e-b95d-4aa6-8adb-a75275eca36d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:32.850427 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a237620e-b95d-4aa6-8adb-a75275eca36d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:32.850863 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a237620e-b95d-4aa6-8adb-a75275eca36d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:32.851545 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a237620e-b95d-4aa6-8adb-a75275eca36d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:32.851992 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a237620e-b95d-4aa6-8adb-a75275eca36d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:32.852433 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a237620e-b95d-4aa6-8adb-a75275eca36d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:32.981580 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a237620e-b95d-4aa6-8adb-a75275eca36d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:32.989806 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a237620e-b95d-4aa6-8adb-a75275eca36d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1720 microversion: 2.1 time: 0.151379 Aug 31 00:38:32.990362 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 226/447] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:32 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:34.010940 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-0cd209cd-6dcf-400e-af4a-8fefe2aba389 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:34.011556 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-0cd209cd-6dcf-400e-af4a-8fefe2aba389 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:34.017688 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0cd209cd-6dcf-400e-af4a-8fefe2aba389 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:34.018161 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0cd209cd-6dcf-400e-af4a-8fefe2aba389 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:34.018591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0cd209cd-6dcf-400e-af4a-8fefe2aba389 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:34.019271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0cd209cd-6dcf-400e-af4a-8fefe2aba389 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:34.019718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0cd209cd-6dcf-400e-af4a-8fefe2aba389 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:34.020137 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0cd209cd-6dcf-400e-af4a-8fefe2aba389 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:34.154240 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0cd209cd-6dcf-400e-af4a-8fefe2aba389 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:34.162386 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-0cd209cd-6dcf-400e-af4a-8fefe2aba389 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1720 microversion: 2.1 time: 0.155280 Aug 31 00:38:34.162938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 222/448] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:34 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:34.530392 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c22fb689-ebae-4ac6-b7d0-b1b443a11e3f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8609c323-46de-4af1-82be-cb10793250c9"}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:38:34.532900 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c22fb689-ebae-4ac6-b7d0-b1b443a11e3f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:34.539258 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c22fb689-ebae-4ac6-b7d0-b1b443a11e3f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:34.539732 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c22fb689-ebae-4ac6-b7d0-b1b443a11e3f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:34.540159 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c22fb689-ebae-4ac6-b7d0-b1b443a11e3f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:34.540859 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c22fb689-ebae-4ac6-b7d0-b1b443a11e3f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:34.541301 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c22fb689-ebae-4ac6-b7d0-b1b443a11e3f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:34.541713 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c22fb689-ebae-4ac6-b7d0-b1b443a11e3f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:35.183630 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9fbafee3-26c0-4b10-9965-446ad0931349 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:35.184162 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9fbafee3-26c0-4b10-9965-446ad0931349 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:35.190524 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9fbafee3-26c0-4b10-9965-446ad0931349 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:35.191000 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9fbafee3-26c0-4b10-9965-446ad0931349 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:35.191434 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9fbafee3-26c0-4b10-9965-446ad0931349 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:35.192116 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9fbafee3-26c0-4b10-9965-446ad0931349 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:35.192592 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9fbafee3-26c0-4b10-9965-446ad0931349 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:35.193011 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9fbafee3-26c0-4b10-9965-446ad0931349 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:35.241066 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c22fb689-ebae-4ac6-b7d0-b1b443a11e3f tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "POST /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.714435 Aug 31 00:38:35.241745 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 227/449] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 00:38:34 2022] POST /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/os-volume_attachments => generated 194 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:35.332229 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-9fbafee3-26c0-4b10-9965-446ad0931349 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:35.340537 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9fbafee3-26c0-4b10-9965-446ad0931349 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1720 microversion: 2.1 time: 0.160873 Aug 31 00:38:35.341098 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 223/450] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:35 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:38:36.365199 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-151fd3aa-9e9c-424c-874a-06749b788b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:36.366772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-151fd3aa-9e9c-424c-874a-06749b788b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:36.374482 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-151fd3aa-9e9c-424c-874a-06749b788b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:36.375001 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-151fd3aa-9e9c-424c-874a-06749b788b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:36.375393 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-151fd3aa-9e9c-424c-874a-06749b788b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:36.378383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-151fd3aa-9e9c-424c-874a-06749b788b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:36.378383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-151fd3aa-9e9c-424c-874a-06749b788b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:36.378383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-151fd3aa-9e9c-424c-874a-06749b788b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:36.511671 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-151fd3aa-9e9c-424c-874a-06749b788b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:36.520826 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-151fd3aa-9e9c-424c-874a-06749b788b9e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1720 microversion: 2.1 time: 0.162374 Aug 31 00:38:36.521393 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 228/451] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:36 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:37.543305 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d4cbfa7d-dd6b-452b-a4bd-7372d19ae908 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:37.543907 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d4cbfa7d-dd6b-452b-a4bd-7372d19ae908 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:37.550536 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d4cbfa7d-dd6b-452b-a4bd-7372d19ae908 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:37.551010 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d4cbfa7d-dd6b-452b-a4bd-7372d19ae908 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:37.554873 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d4cbfa7d-dd6b-452b-a4bd-7372d19ae908 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:37.554873 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d4cbfa7d-dd6b-452b-a4bd-7372d19ae908 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:37.554873 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d4cbfa7d-dd6b-452b-a4bd-7372d19ae908 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:37.554873 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d4cbfa7d-dd6b-452b-a4bd-7372d19ae908 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:37.691769 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d4cbfa7d-dd6b-452b-a4bd-7372d19ae908 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:37.699867 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d4cbfa7d-dd6b-452b-a4bd-7372d19ae908 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1720 microversion: 2.1 time: 0.160620 Aug 31 00:38:37.700444 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 224/452] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:37 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:38.721690 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-bd82cfe4-c8d3-4b6e-96a0-6b486428b194 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:38.722267 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-bd82cfe4-c8d3-4b6e-96a0-6b486428b194 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:38.728833 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd82cfe4-c8d3-4b6e-96a0-6b486428b194 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:38.729315 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd82cfe4-c8d3-4b6e-96a0-6b486428b194 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:38.731843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd82cfe4-c8d3-4b6e-96a0-6b486428b194 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:38.731843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd82cfe4-c8d3-4b6e-96a0-6b486428b194 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:38.731843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd82cfe4-c8d3-4b6e-96a0-6b486428b194 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:38.731843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd82cfe4-c8d3-4b6e-96a0-6b486428b194 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:38.872727 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-bd82cfe4-c8d3-4b6e-96a0-6b486428b194 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:38.881937 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-bd82cfe4-c8d3-4b6e-96a0-6b486428b194 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1720 microversion: 2.1 time: 0.164285 Aug 31 00:38:38.882508 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 229/453] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:38 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:39.903572 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-826d9b3c-18f8-44d0-b467-3a3247245581 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:39.904156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-826d9b3c-18f8-44d0-b467-3a3247245581 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:39.910121 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-826d9b3c-18f8-44d0-b467-3a3247245581 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:39.910596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-826d9b3c-18f8-44d0-b467-3a3247245581 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:39.911018 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-826d9b3c-18f8-44d0-b467-3a3247245581 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:39.911687 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-826d9b3c-18f8-44d0-b467-3a3247245581 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:39.912126 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-826d9b3c-18f8-44d0-b467-3a3247245581 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:39.912671 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-826d9b3c-18f8-44d0-b467-3a3247245581 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:40.039962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-826d9b3c-18f8-44d0-b467-3a3247245581 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:40.048522 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-826d9b3c-18f8-44d0-b467-3a3247245581 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1720 microversion: 2.1 time: 0.148770 Aug 31 00:38:40.049083 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 225/454] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:39 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:41.069505 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8b821744-8722-48f5-80c3-d1921b721098 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:41.070128 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8b821744-8722-48f5-80c3-d1921b721098 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:41.076778 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b821744-8722-48f5-80c3-d1921b721098 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:41.077257 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b821744-8722-48f5-80c3-d1921b721098 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:41.077689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b821744-8722-48f5-80c3-d1921b721098 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:41.079090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b821744-8722-48f5-80c3-d1921b721098 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:41.079610 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b821744-8722-48f5-80c3-d1921b721098 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:41.080030 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b821744-8722-48f5-80c3-d1921b721098 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:41.213014 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8b821744-8722-48f5-80c3-d1921b721098 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:41.221900 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8b821744-8722-48f5-80c3-d1921b721098 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1697 microversion: 2.1 time: 0.155725 Aug 31 00:38:41.221900 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 230/455] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:41 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:41.242285 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-811518ba-9ff5-400d-9bde-c5b71a0c9d4b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:38:41.248222 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-811518ba-9ff5-400d-9bde-c5b71a0c9d4b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:41.248737 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-811518ba-9ff5-400d-9bde-c5b71a0c9d4b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:41.249170 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-811518ba-9ff5-400d-9bde-c5b71a0c9d4b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:41.310641 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-811518ba-9ff5-400d-9bde-c5b71a0c9d4b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Going to try to start instance {{(pid=128048) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 00:38:41.486669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-811518ba-9ff5-400d-9bde-c5b71a0c9d4b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "POST /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf/action" status: 202 len: 0 microversion: 2.1 time: 0.248131 Aug 31 00:38:41.487268 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 226/456] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 00:38:41 2022] POST /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:38:41.495203 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-77d553ba-ded1-4a84-9c77-e62bf92f5903 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:41.495798 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-77d553ba-ded1-4a84-9c77-e62bf92f5903 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:41.501799 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-77d553ba-ded1-4a84-9c77-e62bf92f5903 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:41.502268 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-77d553ba-ded1-4a84-9c77-e62bf92f5903 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:41.502694 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-77d553ba-ded1-4a84-9c77-e62bf92f5903 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:41.503365 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-77d553ba-ded1-4a84-9c77-e62bf92f5903 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:41.503806 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-77d553ba-ded1-4a84-9c77-e62bf92f5903 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:41.504218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-77d553ba-ded1-4a84-9c77-e62bf92f5903 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:41.649698 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-77d553ba-ded1-4a84-9c77-e62bf92f5903 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:41.659976 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-77d553ba-ded1-4a84-9c77-e62bf92f5903 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1706 microversion: 2.1 time: 0.168060 Aug 31 00:38:41.672799 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 231/457] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:41 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1706 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:42.682450 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-e25e0fac-ea92-471b-8040-a4c6ce8d8ace tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:42.683146 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-e25e0fac-ea92-471b-8040-a4c6ce8d8ace tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:42.689643 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e25e0fac-ea92-471b-8040-a4c6ce8d8ace tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:42.690119 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e25e0fac-ea92-471b-8040-a4c6ce8d8ace tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:42.690546 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e25e0fac-ea92-471b-8040-a4c6ce8d8ace tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:42.691234 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e25e0fac-ea92-471b-8040-a4c6ce8d8ace tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:42.691686 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e25e0fac-ea92-471b-8040-a4c6ce8d8ace tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:42.692099 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e25e0fac-ea92-471b-8040-a4c6ce8d8ace tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:42.825825 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-e25e0fac-ea92-471b-8040-a4c6ce8d8ace tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:42.828776 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:42.835234 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-e25e0fac-ea92-471b-8040-a4c6ce8d8ace tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1706 microversion: 2.1 time: 0.157054 Aug 31 00:38:42.835788 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 227/458] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:42 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1706 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:43.867684 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-466bae6d-d048-4ee9-9b8e-e055a6addd4c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:43.868313 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-466bae6d-d048-4ee9-9b8e-e055a6addd4c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:43.871405 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-be10e69a-1c53-403b-a722-6547661d43c1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:38:43.873706 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-be10e69a-1c53-403b-a722-6547661d43c1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:43.875321 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-466bae6d-d048-4ee9-9b8e-e055a6addd4c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:43.875796 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-466bae6d-d048-4ee9-9b8e-e055a6addd4c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:43.876454 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-466bae6d-d048-4ee9-9b8e-e055a6addd4c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:43.877137 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-466bae6d-d048-4ee9-9b8e-e055a6addd4c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:43.877583 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-466bae6d-d048-4ee9-9b8e-e055a6addd4c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:43.878050 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-466bae6d-d048-4ee9-9b8e-e055a6addd4c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:43.880801 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-be10e69a-1c53-403b-a722-6547661d43c1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:43.881286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-be10e69a-1c53-403b-a722-6547661d43c1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:43.881997 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-be10e69a-1c53-403b-a722-6547661d43c1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:43.882868 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-be10e69a-1c53-403b-a722-6547661d43c1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:43.883319 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-be10e69a-1c53-403b-a722-6547661d43c1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:43.883751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-be10e69a-1c53-403b-a722-6547661d43c1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:43.908690 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-be10e69a-1c53-403b-a722-6547661d43c1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lazy-loading 'flavor' on Instance uuid 95f8fa2f-7f69-4291-903c-1618b2c28146 {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:38:44.018866 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-466bae6d-d048-4ee9-9b8e-e055a6addd4c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:44.027267 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-466bae6d-d048-4ee9-9b8e-e055a6addd4c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1706 microversion: 2.1 time: 0.163529 Aug 31 00:38:44.030757 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 232/459] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:43 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1706 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:44.183811 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-be10e69a-1c53-403b-a722-6547661d43c1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "POST /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/action" status: 200 len: 32 microversion: 2.1 time: 0.316566 Aug 31 00:38:44.184441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 228/460] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 00:38:43 2022] POST /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/action => generated 32 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 00:38:44.195101 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f3a8b080-727c-463d-bee5-504651c87a01 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:44.195707 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f3a8b080-727c-463d-bee5-504651c87a01 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:44.201635 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f3a8b080-727c-463d-bee5-504651c87a01 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:44.202117 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f3a8b080-727c-463d-bee5-504651c87a01 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:44.202566 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f3a8b080-727c-463d-bee5-504651c87a01 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:44.203253 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f3a8b080-727c-463d-bee5-504651c87a01 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:44.203695 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f3a8b080-727c-463d-bee5-504651c87a01 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:44.204116 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f3a8b080-727c-463d-bee5-504651c87a01 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:44.331717 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f3a8b080-727c-463d-bee5-504651c87a01 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:44.341123 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f3a8b080-727c-463d-bee5-504651c87a01 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1733 microversion: 2.1 time: 0.150001 Aug 31 00:38:44.341698 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 233/461] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:44 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:45.050086 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-03e73475-69a0-4c60-a792-048337310458 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:45.050887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-03e73475-69a0-4c60-a792-048337310458 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:45.056928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-03e73475-69a0-4c60-a792-048337310458 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:45.057429 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-03e73475-69a0-4c60-a792-048337310458 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:45.057841 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-03e73475-69a0-4c60-a792-048337310458 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:45.058534 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-03e73475-69a0-4c60-a792-048337310458 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:45.058983 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-03e73475-69a0-4c60-a792-048337310458 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:45.059404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-03e73475-69a0-4c60-a792-048337310458 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:45.281270 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-03e73475-69a0-4c60-a792-048337310458 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:45.289560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-03e73475-69a0-4c60-a792-048337310458 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1710 microversion: 2.1 time: 0.244035 Aug 31 00:38:45.290135 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 229/462] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:45 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1710 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:45.363594 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-cac784ce-d4c2-4ac0-a75c-8e60d244e50b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:45.370273 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-cac784ce-d4c2-4ac0-a75c-8e60d244e50b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:45.370781 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cac784ce-d4c2-4ac0-a75c-8e60d244e50b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:45.371265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cac784ce-d4c2-4ac0-a75c-8e60d244e50b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:45.371695 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cac784ce-d4c2-4ac0-a75c-8e60d244e50b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:45.372410 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cac784ce-d4c2-4ac0-a75c-8e60d244e50b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:45.372863 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cac784ce-d4c2-4ac0-a75c-8e60d244e50b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:45.373283 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cac784ce-d4c2-4ac0-a75c-8e60d244e50b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:45.549199 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-cac784ce-d4c2-4ac0-a75c-8e60d244e50b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:45.557445 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-cac784ce-d4c2-4ac0-a75c-8e60d244e50b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1733 microversion: 2.1 time: 0.198475 Aug 31 00:38:45.558010 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 234/463] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:45 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1733 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:45.773151 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-2615f492-4d6e-4230-ad84-f158cb29c5c0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:45.773900 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-2615f492-4d6e-4230-ad84-f158cb29c5c0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:45.779911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2615f492-4d6e-4230-ad84-f158cb29c5c0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:45.780418 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2615f492-4d6e-4230-ad84-f158cb29c5c0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:45.780846 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2615f492-4d6e-4230-ad84-f158cb29c5c0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:45.781528 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2615f492-4d6e-4230-ad84-f158cb29c5c0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:45.781975 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2615f492-4d6e-4230-ad84-f158cb29c5c0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:45.782393 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2615f492-4d6e-4230-ad84-f158cb29c5c0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:45.807762 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-2615f492-4d6e-4230-ad84-f158cb29c5c0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc/ips" status: 200 len: 149 microversion: 2.1 time: 0.038559 Aug 31 00:38:45.808318 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 230/464] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 00:38:45 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:45.820201 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ecac6fac-3699-4bf6-b60d-5dbb6e6c534e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea397145-9b79-48e8-9609-029f40765ff9"}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:38:45.822669 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ecac6fac-3699-4bf6-b60d-5dbb6e6c534e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:45.829028 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ecac6fac-3699-4bf6-b60d-5dbb6e6c534e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:45.829500 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ecac6fac-3699-4bf6-b60d-5dbb6e6c534e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:45.829953 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ecac6fac-3699-4bf6-b60d-5dbb6e6c534e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:45.831454 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ecac6fac-3699-4bf6-b60d-5dbb6e6c534e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:45.831921 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ecac6fac-3699-4bf6-b60d-5dbb6e6c534e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:45.832357 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ecac6fac-3699-4bf6-b60d-5dbb6e6c534e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:45.913179 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-ecac6fac-3699-4bf6-b60d-5dbb6e6c534e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] HTTP exception thrown: Invalid volume: volume ea397145-9b79-48e8-9609-029f40765ff9 is already attached to instances: 64ff706f-9d6e-4268-a6db-3b4c37cf514d Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ecac6fac-3699-4bf6-b60d-5dbb6e6c534e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Request method failure captured: Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: POST /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc/os-volume_attachments HTTP/1.1 Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 74 Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqy7MJOpqb7URH2NMlvnlry7FN8PMqekPyTr4WdpuFP-EJ4P09V7u5pIkcg9D2y64tDq06EhUYjkLoVEA5Xo6OkeLUr7BvIjtmrEoq-poVSUiJYXz83e0U_QXEU4_Gc_m-Y7QkotdhwKhL3RvXqk7a5HcYY_0K_fB-YMAW3D8wMuR_c Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:38:45.914905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:38:45.916253 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:38:45.916253 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:38:45.916253 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:38:45.916253 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:38:45.916253 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:38:45.916253 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:38:45.916253 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:38:45.916253 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 45422a67a78f4784abc0f18ad84778f3 Aug 31 00:38:45.916253 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:38:45.916253 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Aug 31 00:38:45.916253 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {"volumeAttachment": {"volumeId": "ea397145-9b79-48e8-9609-029f40765ff9"}} Aug 31 00:38:45.916253 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:38:45.917069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Invalid volume: volume ea397145-9b79-48e8-9609-029f40765ff9 is already attached to instances: 64ff706f-9d6e-4268-a6db-3b4c37cf514d Aug 31 00:38:45.917069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'server_id': '514a5573-d33c-4d96-bf91-d3b6e21c09dc', 'body': {'volumeAttachment': {'volumeId': 'ea397145-9b79-48e8-9609-029f40765ff9'}}} Aug 31 00:38:45.917069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:38:45.917069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:45.917069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 00:38:45.917069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 00:38:45.917069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:38:45.917069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:38:45.917069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:38:45.917069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:38:45.917069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 00:38:45.917069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 00:38:45.917069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 00:38:45.917069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 00:38:45.917069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ea397145-9b79-48e8-9609-029f40765ff9 is already attached to instances: 64ff706f-9d6e-4268-a6db-3b4c37cf514d Aug 31 00:38:45.917069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:38:45.917069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:45.917069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:38:45.917069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ea397145-9b79-48e8-9609-029f40765ff9 is already attached to instances: 64ff706f-9d6e-4268-a6db-3b4c37cf514d Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:45.918343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:45.919466 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:45.919466 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:38:45.919466 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:38:45.919466 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ea397145-9b79-48e8-9609-029f40765ff9 is already attached to instances: 64ff706f-9d6e-4268-a6db-3b4c37cf514d Aug 31 00:38:45.919466 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:38:45.919466 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ecac6fac-3699-4bf6-b60d-5dbb6e6c534e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Returning 400 to user: Invalid volume: volume ea397145-9b79-48e8-9609-029f40765ff9 is already attached to instances: 64ff706f-9d6e-4268-a6db-3b4c37cf514d {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:38:45.919466 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ecac6fac-3699-4bf6-b60d-5dbb6e6c534e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "POST /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100193 Aug 31 00:38:45.919466 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 235/465] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 00:38:45 2022] POST /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:38:45.926712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7a7c3182-62db-48de-9cae-3cc92420d74e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:45.927233 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7a7c3182-62db-48de-9cae-3cc92420d74e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:45.933254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a7c3182-62db-48de-9cae-3cc92420d74e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:45.933729 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a7c3182-62db-48de-9cae-3cc92420d74e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:45.934190 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a7c3182-62db-48de-9cae-3cc92420d74e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:45.934875 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a7c3182-62db-48de-9cae-3cc92420d74e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:45.935321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a7c3182-62db-48de-9cae-3cc92420d74e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:45.935738 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a7c3182-62db-48de-9cae-3cc92420d74e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:45.960476 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7a7c3182-62db-48de-9cae-3cc92420d74e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Going to try to terminate instance {{(pid=128048) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:38:46.271242 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-7a7c3182-62db-48de-9cae-3cc92420d74e tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "DELETE /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 204 len: 0 microversion: 2.1 time: 0.348621 Aug 31 00:38:46.271898 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 231/466] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:38:45 2022] DELETE /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:38:46.280540 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-43237ad9-5431-41f3-a523-f2edd776807f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:46.281141 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-43237ad9-5431-41f3-a523-f2edd776807f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:46.288218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-43237ad9-5431-41f3-a523-f2edd776807f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:46.288718 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-43237ad9-5431-41f3-a523-f2edd776807f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:46.289144 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-43237ad9-5431-41f3-a523-f2edd776807f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:46.289827 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-43237ad9-5431-41f3-a523-f2edd776807f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:46.290385 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-43237ad9-5431-41f3-a523-f2edd776807f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:46.290798 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-43237ad9-5431-41f3-a523-f2edd776807f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:46.455989 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-43237ad9-5431-41f3-a523-f2edd776807f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:46.463869 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-43237ad9-5431-41f3-a523-f2edd776807f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1681 microversion: 2.1 time: 0.187312 Aug 31 00:38:46.464450 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 236/467] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:46 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:46.579249 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-12251b1c-8d7e-45e8-a302-93ba89db3361 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:46.579956 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-12251b1c-8d7e-45e8-a302-93ba89db3361 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:46.586720 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-12251b1c-8d7e-45e8-a302-93ba89db3361 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:46.587207 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-12251b1c-8d7e-45e8-a302-93ba89db3361 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:46.587642 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-12251b1c-8d7e-45e8-a302-93ba89db3361 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:46.588396 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-12251b1c-8d7e-45e8-a302-93ba89db3361 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:46.588854 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-12251b1c-8d7e-45e8-a302-93ba89db3361 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:46.589278 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-12251b1c-8d7e-45e8-a302-93ba89db3361 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:46.739893 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-12251b1c-8d7e-45e8-a302-93ba89db3361 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:46.748216 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-12251b1c-8d7e-45e8-a302-93ba89db3361 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1733 microversion: 2.1 time: 0.173259 Aug 31 00:38:46.748815 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 232/468] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:46 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:47.486084 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-776c5e05-d2ba-4f85-9f2c-8b3d91518b3f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:47.488057 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-776c5e05-d2ba-4f85-9f2c-8b3d91518b3f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:47.494845 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-776c5e05-d2ba-4f85-9f2c-8b3d91518b3f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:47.495440 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-776c5e05-d2ba-4f85-9f2c-8b3d91518b3f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:47.495871 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-776c5e05-d2ba-4f85-9f2c-8b3d91518b3f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:47.496576 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-776c5e05-d2ba-4f85-9f2c-8b3d91518b3f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:47.501842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-776c5e05-d2ba-4f85-9f2c-8b3d91518b3f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:47.501842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-776c5e05-d2ba-4f85-9f2c-8b3d91518b3f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:47.640436 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-776c5e05-d2ba-4f85-9f2c-8b3d91518b3f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:47.649444 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-776c5e05-d2ba-4f85-9f2c-8b3d91518b3f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1681 microversion: 2.1 time: 0.167301 Aug 31 00:38:47.650006 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 237/469] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:47 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:47.775657 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-553c3c8e-710e-4d28-a1ef-fa42178f69c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:47.776245 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-553c3c8e-710e-4d28-a1ef-fa42178f69c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:47.782324 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-553c3c8e-710e-4d28-a1ef-fa42178f69c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:47.782803 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-553c3c8e-710e-4d28-a1ef-fa42178f69c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:47.783237 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-553c3c8e-710e-4d28-a1ef-fa42178f69c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:47.783945 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-553c3c8e-710e-4d28-a1ef-fa42178f69c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:47.784425 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-553c3c8e-710e-4d28-a1ef-fa42178f69c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:47.784872 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-553c3c8e-710e-4d28-a1ef-fa42178f69c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:47.917323 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-553c3c8e-710e-4d28-a1ef-fa42178f69c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:47.925556 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-553c3c8e-710e-4d28-a1ef-fa42178f69c7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1733 microversion: 2.1 time: 0.154090 Aug 31 00:38:47.926113 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 233/470] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:47 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:48.671030 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c16d6102-fdcd-4283-9724-ff0e27268d51 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:48.671644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c16d6102-fdcd-4283-9724-ff0e27268d51 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:48.674120 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=45 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:48.678870 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c16d6102-fdcd-4283-9724-ff0e27268d51 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:48.679358 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c16d6102-fdcd-4283-9724-ff0e27268d51 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:48.679791 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c16d6102-fdcd-4283-9724-ff0e27268d51 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:48.680518 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c16d6102-fdcd-4283-9724-ff0e27268d51 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:48.680971 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c16d6102-fdcd-4283-9724-ff0e27268d51 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:48.681395 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c16d6102-fdcd-4283-9724-ff0e27268d51 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:48.699342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:48.751101 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-c16d6102-fdcd-4283-9724-ff0e27268d51 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:48.757801 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c16d6102-fdcd-4283-9724-ff0e27268d51 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1613 microversion: 2.1 time: 0.090597 Aug 31 00:38:48.758382 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 238/471] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:48 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1613 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:48.947057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-eab4cb4d-f296-4964-9f75-ab5891bdf43a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:48.948351 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-eab4cb4d-f296-4964-9f75-ab5891bdf43a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:48.954672 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eab4cb4d-f296-4964-9f75-ab5891bdf43a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:48.955439 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eab4cb4d-f296-4964-9f75-ab5891bdf43a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:48.955880 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eab4cb4d-f296-4964-9f75-ab5891bdf43a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:48.956603 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eab4cb4d-f296-4964-9f75-ab5891bdf43a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:48.957057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eab4cb4d-f296-4964-9f75-ab5891bdf43a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:48.958382 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eab4cb4d-f296-4964-9f75-ab5891bdf43a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:48.982012 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-903a20b1-348a-4f85-904e-05821122021b req-2e48be17-04bf-4569-a161-badd7524def1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514a5573-d33c-4d96-bf91-d3b6e21c09dc", "name": "network-vif-deleted", "tag": "e8da9c81-1278-4164-a96f-8a1a32121ece"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:38:48.997058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-903a20b1-348a-4f85-904e-05821122021b req-2e48be17-04bf-4569-a161-badd7524def1 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:48.997058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-903a20b1-348a-4f85-904e-05821122021b req-2e48be17-04bf-4569-a161-badd7524def1 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:48.997058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-903a20b1-348a-4f85-904e-05821122021b req-2e48be17-04bf-4569-a161-badd7524def1 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:49.010007 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-903a20b1-348a-4f85-904e-05821122021b req-2e48be17-04bf-4569-a161-badd7524def1 service nova] Creating event network-vif-deleted:e8da9c81-1278-4164-a96f-8a1a32121ece for instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc on hv-cinder-85221 Aug 31 00:38:49.015962 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-903a20b1-348a-4f85-904e-05821122021b req-2e48be17-04bf-4569-a161-badd7524def1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038275 Aug 31 00:38:49.016601 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 239/472] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:49.119190 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-eab4cb4d-f296-4964-9f75-ab5891bdf43a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:49.138716 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-eab4cb4d-f296-4964-9f75-ab5891bdf43a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1733 microversion: 2.1 time: 0.195389 Aug 31 00:38:49.139633 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 234/473] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:48 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1733 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:49.781671 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ecad9bd8-4ae1-487e-a096-304bb84ca6dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:49.782996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ecad9bd8-4ae1-487e-a096-304bb84ca6dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:49.792140 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ecad9bd8-4ae1-487e-a096-304bb84ca6dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:49.792573 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ecad9bd8-4ae1-487e-a096-304bb84ca6dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:49.793205 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ecad9bd8-4ae1-487e-a096-304bb84ca6dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:49.794070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ecad9bd8-4ae1-487e-a096-304bb84ca6dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:49.794676 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ecad9bd8-4ae1-487e-a096-304bb84ca6dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:49.795267 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ecad9bd8-4ae1-487e-a096-304bb84ca6dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:49.838763 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ecad9bd8-4ae1-487e-a096-304bb84ca6dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:49.839254 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ecad9bd8-4ae1-487e-a096-304bb84ca6dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:49.839690 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ecad9bd8-4ae1-487e-a096-304bb84ca6dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:49.840145 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-ecad9bd8-4ae1-487e-a096-304bb84ca6dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lazy-loading 'fault' on Instance uuid 514a5573-d33c-4d96-bf91-d3b6e21c09dc {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:38:49.888055 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ecad9bd8-4ae1-487e-a096-304bb84ca6dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:49.898137 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ecad9bd8-4ae1-487e-a096-304bb84ca6dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 200 len: 1331 microversion: 2.1 time: 0.120259 Aug 31 00:38:49.899128 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 240/474] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:49 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 1331 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:50.162208 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-1890f686-5a44-4cef-bbd7-1bc6138f1008 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:50.162989 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-1890f686-5a44-4cef-bbd7-1bc6138f1008 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:50.169151 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1890f686-5a44-4cef-bbd7-1bc6138f1008 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:50.169621 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1890f686-5a44-4cef-bbd7-1bc6138f1008 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:50.170052 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1890f686-5a44-4cef-bbd7-1bc6138f1008 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:50.170750 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1890f686-5a44-4cef-bbd7-1bc6138f1008 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:50.171195 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1890f686-5a44-4cef-bbd7-1bc6138f1008 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:50.171611 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1890f686-5a44-4cef-bbd7-1bc6138f1008 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:50.326232 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-1890f686-5a44-4cef-bbd7-1bc6138f1008 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:50.341704 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-1890f686-5a44-4cef-bbd7-1bc6138f1008 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1733 microversion: 2.1 time: 0.178251 Aug 31 00:38:50.341704 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 235/475] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:50 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:50.920352 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ae57beef-d13d-4821-90f5-d38901c30fd3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:50.920998 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ae57beef-d13d-4821-90f5-d38901c30fd3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:50.928152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ae57beef-d13d-4821-90f5-d38901c30fd3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:50.928688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ae57beef-d13d-4821-90f5-d38901c30fd3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:50.929116 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ae57beef-d13d-4821-90f5-d38901c30fd3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:50.929821 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ae57beef-d13d-4821-90f5-d38901c30fd3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:50.930263 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ae57beef-d13d-4821-90f5-d38901c30fd3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:50.930677 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ae57beef-d13d-4821-90f5-d38901c30fd3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:50.945089 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-ae57beef-d13d-4821-90f5-d38901c30fd3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] HTTP exception thrown: Instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc could not be found. Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ae57beef-d13d-4821-90f5-d38901c30fd3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Request method failure captured: Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc HTTP/1.1 Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqy7MJOpqb7URH2NMlvnlry7FN8PMqekPyTr4WdpuFP-EJ4P09V7u5pIkcg9D2y64tDq06EhUYjkLoVEA5Xo6OkeLUr7BvIjtmrEoq-poVSUiJYXz83e0U_QXEU4_Gc_m-Y7QkotdhwKhL3RvXqk7a5HcYY_0K_fB-YMAW3D8wMuR_c Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:38:50.946636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:38:50.948148 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:38:50.948148 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:38:50.948148 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:38:50.948148 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:38:50.948148 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:38:50.948148 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:38:50.948148 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:38:50.948148 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 45422a67a78f4784abc0f18ad84778f3 Aug 31 00:38:50.948148 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:38:50.948148 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:38:50.948148 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc could not be found. Aug 31 00:38:50.948148 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': '514a5573-d33c-4d96-bf91-d3b6e21c09dc'} Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc could not be found. Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:38:50.949091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:38:50.950448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:38:50.950448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:38:50.950448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:38:50.950448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:38:50.950448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:38:50.950448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:38:50.950448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:38:50.950448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc could not be found. Aug 31 00:38:50.950448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:38:50.950448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:50.950448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:38:50.950448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:50.950448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:50.950448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:50.950448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:38:50.950448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:38:50.950448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc could not be found. Aug 31 00:38:50.950448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:38:50.951779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ae57beef-d13d-4821-90f5-d38901c30fd3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Returning 404 to user: Instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:38:50.951779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ae57beef-d13d-4821-90f5-d38901c30fd3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 404 len: 111 microversion: 2.1 time: 0.031719 Aug 31 00:38:50.951779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 241/476] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:50 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:38:50.956907 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-61cb5364-2ca5-48d7-9c6e-9491ed94ac08 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '.version_select at 0x7f551ee2c0d0>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:51.044155 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-61cb5364-2ca5-48d7-9c6e-9491ed94ac08 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964621660" status: 202 len: 0 microversion: 2.1 time: 0.091007 Aug 31 00:38:51.048185 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 236/477] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Aug 31 00:38:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964621660 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:38:51.357838 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8e027237-1512-4c59-8c78-1210cfde3fb3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:51.358419 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8e027237-1512-4c59-8c78-1210cfde3fb3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:51.365473 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e027237-1512-4c59-8c78-1210cfde3fb3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:51.365976 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e027237-1512-4c59-8c78-1210cfde3fb3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:51.366387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e027237-1512-4c59-8c78-1210cfde3fb3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:51.367079 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e027237-1512-4c59-8c78-1210cfde3fb3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:51.367526 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e027237-1512-4c59-8c78-1210cfde3fb3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:51.367948 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e027237-1512-4c59-8c78-1210cfde3fb3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:51.600039 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8e027237-1512-4c59-8c78-1210cfde3fb3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:51.608257 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8e027237-1512-4c59-8c78-1210cfde3fb3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1733 microversion: 2.1 time: 0.254225 Aug 31 00:38:51.608836 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 242/478] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:51 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1733 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:51.962746 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-817adb1c-0d38-40c4-9cbd-c3e6edaddfe6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:51.963312 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-817adb1c-0d38-40c4-9cbd-c3e6edaddfe6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:51.969196 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-817adb1c-0d38-40c4-9cbd-c3e6edaddfe6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:51.969687 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-817adb1c-0d38-40c4-9cbd-c3e6edaddfe6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:51.970091 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-817adb1c-0d38-40c4-9cbd-c3e6edaddfe6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:51.970804 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-817adb1c-0d38-40c4-9cbd-c3e6edaddfe6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:51.971239 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-817adb1c-0d38-40c4-9cbd-c3e6edaddfe6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:51.971690 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-817adb1c-0d38-40c4-9cbd-c3e6edaddfe6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:52.101383 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-817adb1c-0d38-40c4-9cbd-c3e6edaddfe6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lazy-loading 'services' on Instance uuid 64ff706f-9d6e-4268-a6db-3b4c37cf514d {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:38:52.311031 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-817adb1c-0d38-40c4-9cbd-c3e6edaddfe6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "DELETE /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d/os-volume_attachments/ea397145-9b79-48e8-9609-029f40765ff9" status: 202 len: 0 microversion: 2.1 time: 0.352161 Aug 31 00:38:52.311626 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 237/479] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 00:38:51 2022] DELETE /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d/os-volume_attachments/ea397145-9b79-48e8-9609-029f40765ff9 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:38:52.326363 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8819d4c8-1e83-4615-911d-85d9ffa2a9da tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:52.328820 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8819d4c8-1e83-4615-911d-85d9ffa2a9da tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:52.335327 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8819d4c8-1e83-4615-911d-85d9ffa2a9da tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:52.335843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8819d4c8-1e83-4615-911d-85d9ffa2a9da tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:52.336301 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8819d4c8-1e83-4615-911d-85d9ffa2a9da tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:52.337011 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8819d4c8-1e83-4615-911d-85d9ffa2a9da tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:52.337463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8819d4c8-1e83-4615-911d-85d9ffa2a9da tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:52.337884 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8819d4c8-1e83-4615-911d-85d9ffa2a9da tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:52.368126 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8819d4c8-1e83-4615-911d-85d9ffa2a9da tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045898 Aug 31 00:38:52.368774 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 243/480] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:52 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:38:52.630265 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-5a6b53c9-4a9a-4b0a-9422-514e6d8ebdde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:52.631006 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-5a6b53c9-4a9a-4b0a-9422-514e6d8ebdde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:52.637253 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5a6b53c9-4a9a-4b0a-9422-514e6d8ebdde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:52.637723 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5a6b53c9-4a9a-4b0a-9422-514e6d8ebdde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:52.638147 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5a6b53c9-4a9a-4b0a-9422-514e6d8ebdde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:52.638818 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5a6b53c9-4a9a-4b0a-9422-514e6d8ebdde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:52.639260 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5a6b53c9-4a9a-4b0a-9422-514e6d8ebdde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:52.639674 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5a6b53c9-4a9a-4b0a-9422-514e6d8ebdde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:52.770171 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-5a6b53c9-4a9a-4b0a-9422-514e6d8ebdde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:52.778722 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-5a6b53c9-4a9a-4b0a-9422-514e6d8ebdde tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1733 microversion: 2.1 time: 0.152892 Aug 31 00:38:52.779274 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 238/481] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:52 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:53.381657 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4f80302f-f7a6-43c5-9968-bc97ccc2944f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:53.384897 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4f80302f-f7a6-43c5-9968-bc97ccc2944f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:53.391674 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4f80302f-f7a6-43c5-9968-bc97ccc2944f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:53.392160 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4f80302f-f7a6-43c5-9968-bc97ccc2944f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:53.392738 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4f80302f-f7a6-43c5-9968-bc97ccc2944f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:53.393436 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4f80302f-f7a6-43c5-9968-bc97ccc2944f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:53.393888 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4f80302f-f7a6-43c5-9968-bc97ccc2944f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:53.394974 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4f80302f-f7a6-43c5-9968-bc97ccc2944f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:53.425847 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4f80302f-f7a6-43c5-9968-bc97ccc2944f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048704 Aug 31 00:38:53.426534 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 244/482] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:53 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:53.801799 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-8ea605de-2a77-4b6f-ac16-865ccb93c4fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:53.802631 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-8ea605de-2a77-4b6f-ac16-865ccb93c4fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:53.808896 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ea605de-2a77-4b6f-ac16-865ccb93c4fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:53.809384 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ea605de-2a77-4b6f-ac16-865ccb93c4fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:53.809823 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ea605de-2a77-4b6f-ac16-865ccb93c4fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:53.810723 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ea605de-2a77-4b6f-ac16-865ccb93c4fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:53.811180 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ea605de-2a77-4b6f-ac16-865ccb93c4fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:53.811907 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ea605de-2a77-4b6f-ac16-865ccb93c4fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:53.942930 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-8ea605de-2a77-4b6f-ac16-865ccb93c4fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:53.951066 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-8ea605de-2a77-4b6f-ac16-865ccb93c4fa tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1733 microversion: 2.1 time: 0.154236 Aug 31 00:38:53.951621 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 239/483] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:53 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:38:54.437882 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-e61445db-6572-4f87-a8ce-a69351b06f86 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:54.445656 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-e61445db-6572-4f87-a8ce-a69351b06f86 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:54.447720 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e61445db-6572-4f87-a8ce-a69351b06f86 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:54.448267 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e61445db-6572-4f87-a8ce-a69351b06f86 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:54.448681 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e61445db-6572-4f87-a8ce-a69351b06f86 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:54.449362 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e61445db-6572-4f87-a8ce-a69351b06f86 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:54.449800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e61445db-6572-4f87-a8ce-a69351b06f86 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:54.450218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e61445db-6572-4f87-a8ce-a69351b06f86 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:54.480801 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-e61445db-6572-4f87-a8ce-a69351b06f86 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046984 Aug 31 00:38:54.481532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 245/484] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:38:54 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:38:54.543594 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-39d7a6a2-e1cb-44f5-9209-40c8f8d4e5bd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:54.544088 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-39d7a6a2-e1cb-44f5-9209-40c8f8d4e5bd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:54.550817 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-39d7a6a2-e1cb-44f5-9209-40c8f8d4e5bd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:54.551369 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-39d7a6a2-e1cb-44f5-9209-40c8f8d4e5bd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:54.551799 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-39d7a6a2-e1cb-44f5-9209-40c8f8d4e5bd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:54.552529 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-39d7a6a2-e1cb-44f5-9209-40c8f8d4e5bd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:54.552979 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-39d7a6a2-e1cb-44f5-9209-40c8f8d4e5bd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:54.553885 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-39d7a6a2-e1cb-44f5-9209-40c8f8d4e5bd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:54.580273 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-39d7a6a2-e1cb-44f5-9209-40c8f8d4e5bd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Going to try to terminate instance {{(pid=128048) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:38:54.604277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:54.825778 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-39d7a6a2-e1cb-44f5-9209-40c8f8d4e5bd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "DELETE /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 204 len: 0 microversion: 2.1 time: 0.285527 Aug 31 00:38:54.826404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 240/485] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:38:54 2022] DELETE /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:38:54.834539 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-475ce67a-5e75-402f-9371-1a94d449fcd0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:54.835143 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-475ce67a-5e75-402f-9371-1a94d449fcd0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:54.841943 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-475ce67a-5e75-402f-9371-1a94d449fcd0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:54.842415 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-475ce67a-5e75-402f-9371-1a94d449fcd0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:54.842844 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-475ce67a-5e75-402f-9371-1a94d449fcd0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:54.843559 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-475ce67a-5e75-402f-9371-1a94d449fcd0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:54.844003 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-475ce67a-5e75-402f-9371-1a94d449fcd0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:54.844442 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-475ce67a-5e75-402f-9371-1a94d449fcd0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:54.973584 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-185fbf53-e4d1-4427-a308-0e40d66ce38d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:54.974263 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-185fbf53-e4d1-4427-a308-0e40d66ce38d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:54.980312 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-185fbf53-e4d1-4427-a308-0e40d66ce38d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:54.980840 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-185fbf53-e4d1-4427-a308-0e40d66ce38d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:54.981247 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-185fbf53-e4d1-4427-a308-0e40d66ce38d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:54.981930 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-185fbf53-e4d1-4427-a308-0e40d66ce38d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:54.982374 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-185fbf53-e4d1-4427-a308-0e40d66ce38d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:54.982817 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-185fbf53-e4d1-4427-a308-0e40d66ce38d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:54.983220 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-475ce67a-5e75-402f-9371-1a94d449fcd0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:54.991350 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-475ce67a-5e75-402f-9371-1a94d449fcd0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1683 microversion: 2.1 time: 0.160621 Aug 31 00:38:54.992132 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 246/486] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:54 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:55.120295 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-185fbf53-e4d1-4427-a308-0e40d66ce38d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:55.129329 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-185fbf53-e4d1-4427-a308-0e40d66ce38d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1733 microversion: 2.1 time: 0.159583 Aug 31 00:38:55.130000 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 241/487] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:54 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:38:56.013605 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ec0332e3-6012-4d08-b77e-ba1e794e9510 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:56.014205 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ec0332e3-6012-4d08-b77e-ba1e794e9510 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:56.021639 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec0332e3-6012-4d08-b77e-ba1e794e9510 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:56.022279 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec0332e3-6012-4d08-b77e-ba1e794e9510 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:56.022902 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec0332e3-6012-4d08-b77e-ba1e794e9510 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:56.023617 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec0332e3-6012-4d08-b77e-ba1e794e9510 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:56.024343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec0332e3-6012-4d08-b77e-ba1e794e9510 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:56.024764 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec0332e3-6012-4d08-b77e-ba1e794e9510 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:56.151991 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9f3af49c-b371-430f-8027-4888d95c00b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:56.152627 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9f3af49c-b371-430f-8027-4888d95c00b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:56.158230 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ec0332e3-6012-4d08-b77e-ba1e794e9510 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:56.158597 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f3af49c-b371-430f-8027-4888d95c00b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:56.159083 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f3af49c-b371-430f-8027-4888d95c00b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:56.159521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f3af49c-b371-430f-8027-4888d95c00b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:56.160218 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f3af49c-b371-430f-8027-4888d95c00b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:56.160742 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f3af49c-b371-430f-8027-4888d95c00b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:56.161777 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f3af49c-b371-430f-8027-4888d95c00b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:56.166919 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ec0332e3-6012-4d08-b77e-ba1e794e9510 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1683 microversion: 2.1 time: 0.157254 Aug 31 00:38:56.167477 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 247/488] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:56 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:56.289853 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-9f3af49c-b371-430f-8027-4888d95c00b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:56.297944 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9f3af49c-b371-430f-8027-4888d95c00b0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1733 microversion: 2.1 time: 0.150043 Aug 31 00:38:56.298496 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 242/489] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:56 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:38:57.188290 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-1e02e430-abfe-420c-b19a-89d3842052db tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:57.197271 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-1e02e430-abfe-420c-b19a-89d3842052db tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:57.197271 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1e02e430-abfe-420c-b19a-89d3842052db tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:57.197271 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1e02e430-abfe-420c-b19a-89d3842052db tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:57.197271 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1e02e430-abfe-420c-b19a-89d3842052db tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:57.197667 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1e02e430-abfe-420c-b19a-89d3842052db tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:57.198061 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1e02e430-abfe-420c-b19a-89d3842052db tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:57.198479 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1e02e430-abfe-420c-b19a-89d3842052db tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:57.320112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c618df90-4485-4567-b652-16731eaf3016 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:57.320664 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c618df90-4485-4567-b652-16731eaf3016 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:57.327950 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c618df90-4485-4567-b652-16731eaf3016 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:57.328471 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c618df90-4485-4567-b652-16731eaf3016 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:57.328910 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c618df90-4485-4567-b652-16731eaf3016 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:57.329606 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c618df90-4485-4567-b652-16731eaf3016 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:57.330055 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c618df90-4485-4567-b652-16731eaf3016 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:57.330213 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-1e02e430-abfe-420c-b19a-89d3842052db tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:57.330470 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c618df90-4485-4567-b652-16731eaf3016 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:57.339325 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-1e02e430-abfe-420c-b19a-89d3842052db tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1683 microversion: 2.1 time: 0.154856 Aug 31 00:38:57.340436 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 248/490] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:57 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:57.552712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c618df90-4485-4567-b652-16731eaf3016 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:57.561168 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-c618df90-4485-4567-b652-16731eaf3016 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1733 microversion: 2.1 time: 0.245702 Aug 31 00:38:57.561749 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 243/491] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:57 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1733 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:58.000189 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-9ebccb16-ada3-4587-a965-42046e2eface req-19916c59-6eab-4618-a8b3-fc5d23f09717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64ff706f-9d6e-4268-a6db-3b4c37cf514d", "name": "network-vif-deleted", "tag": "013e1a99-4ff0-465e-a5a1-038efacbed7c"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:38:58.010749 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-9ebccb16-ada3-4587-a965-42046e2eface req-19916c59-6eab-4618-a8b3-fc5d23f09717 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:58.011224 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-9ebccb16-ada3-4587-a965-42046e2eface req-19916c59-6eab-4618-a8b3-fc5d23f09717 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:58.011747 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-9ebccb16-ada3-4587-a965-42046e2eface req-19916c59-6eab-4618-a8b3-fc5d23f09717 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:58.024468 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-9ebccb16-ada3-4587-a965-42046e2eface req-19916c59-6eab-4618-a8b3-fc5d23f09717 service nova] Creating event network-vif-deleted:013e1a99-4ff0-465e-a5a1-038efacbed7c for instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d on hv-cinder-85221 Aug 31 00:38:58.029640 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-9ebccb16-ada3-4587-a965-42046e2eface req-19916c59-6eab-4618-a8b3-fc5d23f09717 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033135 Aug 31 00:38:58.030293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 249/492] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:38:58.363623 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d107e090-da67-4be7-91be-e2c72a17f515 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:58.365179 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d107e090-da67-4be7-91be-e2c72a17f515 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:58.371361 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d107e090-da67-4be7-91be-e2c72a17f515 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:58.373810 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d107e090-da67-4be7-91be-e2c72a17f515 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:58.373810 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d107e090-da67-4be7-91be-e2c72a17f515 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:58.375628 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d107e090-da67-4be7-91be-e2c72a17f515 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:58.376100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d107e090-da67-4be7-91be-e2c72a17f515 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:58.378436 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d107e090-da67-4be7-91be-e2c72a17f515 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:58.417022 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d107e090-da67-4be7-91be-e2c72a17f515 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:58.417656 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d107e090-da67-4be7-91be-e2c72a17f515 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:58.418104 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d107e090-da67-4be7-91be-e2c72a17f515 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:58.418567 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-d107e090-da67-4be7-91be-e2c72a17f515 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lazy-loading 'fault' on Instance uuid 64ff706f-9d6e-4268-a6db-3b4c37cf514d {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:38:58.495508 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d107e090-da67-4be7-91be-e2c72a17f515 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:58.506553 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d107e090-da67-4be7-91be-e2c72a17f515 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 200 len: 1332 microversion: 2.1 time: 0.146881 Aug 31 00:38:58.507172 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 244/493] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:58 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 1332 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:58.589857 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-2e5ac690-2954-4c1e-9cec-a6f046004029 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:58.590917 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-2e5ac690-2954-4c1e-9cec-a6f046004029 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:58.597429 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2e5ac690-2954-4c1e-9cec-a6f046004029 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:58.598248 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2e5ac690-2954-4c1e-9cec-a6f046004029 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:58.598682 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2e5ac690-2954-4c1e-9cec-a6f046004029 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:58.599381 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2e5ac690-2954-4c1e-9cec-a6f046004029 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:58.599910 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2e5ac690-2954-4c1e-9cec-a6f046004029 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:58.600372 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2e5ac690-2954-4c1e-9cec-a6f046004029 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:58.752458 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-2e5ac690-2954-4c1e-9cec-a6f046004029 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:58.763094 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-2e5ac690-2954-4c1e-9cec-a6f046004029 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1733 microversion: 2.1 time: 0.180136 Aug 31 00:38:58.763094 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 250/494] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:58 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:38:59.528997 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-da8948ad-c0bc-4309-9fa6-3fe66b6caa2c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:59.529620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-da8948ad-c0bc-4309-9fa6-3fe66b6caa2c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:59.535700 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-da8948ad-c0bc-4309-9fa6-3fe66b6caa2c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:59.536172 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-da8948ad-c0bc-4309-9fa6-3fe66b6caa2c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:59.536627 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-da8948ad-c0bc-4309-9fa6-3fe66b6caa2c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:59.537301 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-da8948ad-c0bc-4309-9fa6-3fe66b6caa2c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:59.537744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-da8948ad-c0bc-4309-9fa6-3fe66b6caa2c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:59.538158 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-da8948ad-c0bc-4309-9fa6-3fe66b6caa2c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:59.551909 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-da8948ad-c0bc-4309-9fa6-3fe66b6caa2c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] HTTP exception thrown: Instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d could not be found. Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-da8948ad-c0bc-4309-9fa6-3fe66b6caa2c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Request method failure captured: Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d HTTP/1.1 Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDqy7MJOpqb7URH2NMlvnlry7FN8PMqekPyTr4WdpuFP-EJ4P09V7u5pIkcg9D2y64tDq06EhUYjkLoVEA5Xo6OkeLUr7BvIjtmrEoq-poVSUiJYXz83e0U_QXEU4_Gc_m-Y7QkotdhwKhL3RvXqk7a5HcYY_0K_fB-YMAW3D8wMuR_c Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:38:59.553574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:38:59.557837 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:38:59.557837 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:38:59.557837 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:38:59.557837 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:38:59.557837 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:38:59.557837 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:38:59.557837 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:38:59.557837 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 45422a67a78f4784abc0f18ad84778f3 Aug 31 00:38:59.557837 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:38:59.557837 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:38:59.557837 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d could not be found. Aug 31 00:38:59.557837 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': '64ff706f-9d6e-4268-a6db-3b4c37cf514d'} Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d could not be found. Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:38:59.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:38:59.560093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:38:59.560093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:38:59.560093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:38:59.560093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:38:59.560093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:38:59.560093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:38:59.560093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:38:59.560093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d could not be found. Aug 31 00:38:59.560093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:38:59.560093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:38:59.560093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:38:59.560093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:38:59.560093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:38:59.560093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:38:59.560093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:38:59.560093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:38:59.560093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d could not be found. Aug 31 00:38:59.560093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:38:59.561353 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-da8948ad-c0bc-4309-9fa6-3fe66b6caa2c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Returning 404 to user: Instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:38:59.561353 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-da8948ad-c0bc-4309-9fa6-3fe66b6caa2c tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 404 len: 111 microversion: 2.1 time: 0.029920 Aug 31 00:38:59.561353 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 245/495] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:59 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:38:59.563956 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-005f54b1-ac7d-4fe5-9d54-9b68c31a37d3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '.version_select at 0x7f551eb38c10>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:59.620734 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-005f54b1-ac7d-4fe5-9d54-9b68c31a37d3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774872595" status: 202 len: 0 microversion: 2.1 time: 0.060496 Aug 31 00:38:59.621407 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 251/496] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Aug 31 00:38:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774872595 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:38:59.784453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-14869aea-7930-4694-bd14-ffdcb824c51d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:38:59.785059 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-14869aea-7930-4694-bd14-ffdcb824c51d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:38:59.786983 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:59.791642 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-14869aea-7930-4694-bd14-ffdcb824c51d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:59.792125 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-14869aea-7930-4694-bd14-ffdcb824c51d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:59.792593 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-14869aea-7930-4694-bd14-ffdcb824c51d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:59.793281 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-14869aea-7930-4694-bd14-ffdcb824c51d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:38:59.793727 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-14869aea-7930-4694-bd14-ffdcb824c51d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:38:59.794148 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-14869aea-7930-4694-bd14-ffdcb824c51d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:38:59.936124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-14869aea-7930-4694-bd14-ffdcb824c51d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:38:59.945718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-14869aea-7930-4694-bd14-ffdcb824c51d tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1733 microversion: 2.1 time: 0.165216 Aug 31 00:38:59.946291 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 246/497] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:38:59 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:00.304035 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-135abae9-7e20-4bd3-8bb4-b94aad97edf3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Action: 'create', calling method: .version_select at 0x7f551eb55f70>, body: {"keypair": {"name": "tempest-keypair-1053373980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvkle/gIjiUEQED8zEfwLcjIa7TyS1bEnyv1ryRpuJFJYLve2B89b2igUjt8sPeENAxVrfR3zQi4JRv7lcnjeGfZ3LDtdaiz0vllzysqCima/L3i0Xma/2IkLCFywEZFw=="}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:00.320124 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-135abae9-7e20-4bd3-8bb4-b94aad97edf3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Getting quotas for project ec5893d9a55f4ed28f6579397d0d6f21. Resources: {'key_pairs'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:39:00.323906 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-135abae9-7e20-4bd3-8bb4-b94aad97edf3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Getting quotas for user 45422a67a78f4784abc0f18ad84778f3 and project ec5893d9a55f4ed28f6579397d0d6f21. Resources: {'key_pairs'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:39:00.399336 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-135abae9-7e20-4bd3-8bb4-b94aad97edf3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099967 Aug 31 00:39:00.399960 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 252/498] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 00:39:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:00.967027 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-52a35408-9e7b-42da-a905-570b0fefdc63 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:00.967629 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-52a35408-9e7b-42da-a905-570b0fefdc63 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:00.974081 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-52a35408-9e7b-42da-a905-570b0fefdc63 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:00.974565 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-52a35408-9e7b-42da-a905-570b0fefdc63 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:00.975029 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-52a35408-9e7b-42da-a905-570b0fefdc63 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:00.975714 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-52a35408-9e7b-42da-a905-570b0fefdc63 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:00.976193 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-52a35408-9e7b-42da-a905-570b0fefdc63 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:00.976644 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-52a35408-9e7b-42da-a905-570b0fefdc63 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:01.122059 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-52a35408-9e7b-42da-a905-570b0fefdc63 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:01.131053 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-52a35408-9e7b-42da-a905-570b0fefdc63 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1733 microversion: 2.1 time: 0.167711 Aug 31 00:39:01.131771 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 247/499] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:00 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:02.156004 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b84733d6-560a-449a-89d1-3d08d729d932 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:02.156004 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-b84733d6-560a-449a-89d1-3d08d729d932 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:02.161016 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b84733d6-560a-449a-89d1-3d08d729d932 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:02.161753 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b84733d6-560a-449a-89d1-3d08d729d932 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:02.162191 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b84733d6-560a-449a-89d1-3d08d729d932 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:02.162884 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b84733d6-560a-449a-89d1-3d08d729d932 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:02.163335 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b84733d6-560a-449a-89d1-3d08d729d932 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:02.163753 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b84733d6-560a-449a-89d1-3d08d729d932 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:02.302402 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-b84733d6-560a-449a-89d1-3d08d729d932 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:02.310885 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-b84733d6-560a-449a-89d1-3d08d729d932 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1733 microversion: 2.1 time: 0.161104 Aug 31 00:39:02.311539 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 253/500] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:02 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:02.430809 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-aa2b95b7-1528-48bc-9ddf-2c2a8d818d88 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1546603167", "imageRef": "12947ed8-8ca9-442d-9224-509e79a198e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d427232-8e26-4216-9399-96dea4f30f86"}], "security_groups": [{"name": "tempest-securitygroup--1600223421"}], "key_name": "tempest-keypair-1053373980", "user_data": "}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:02.534309 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.network.neutron [None req-aa2b95b7-1528-48bc-9ddf-2c2a8d818d88 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] validate_networks() for [('6d427232-8e26-4216-9399-96dea4f30f86', None, None, None, None, None)] {{(pid=128048) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:39:02.914741 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-aa2b95b7-1528-48bc-9ddf-2c2a8d818d88 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Flavor limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:39:02.915243 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-aa2b95b7-1528-48bc-9ddf-2c2a8d818d88 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Image limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:39:02.915861 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-aa2b95b7-1528-48bc-9ddf-2c2a8d818d88 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Flavor pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:39:02.916289 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-aa2b95b7-1528-48bc-9ddf-2c2a8d818d88 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Image pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:39:02.916722 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-aa2b95b7-1528-48bc-9ddf-2c2a8d818d88 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:39:02.926337 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aa2b95b7-1528-48bc-9ddf-2c2a8d818d88 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:02.926825 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aa2b95b7-1528-48bc-9ddf-2c2a8d818d88 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:02.927386 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aa2b95b7-1528-48bc-9ddf-2c2a8d818d88 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:02.928102 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aa2b95b7-1528-48bc-9ddf-2c2a8d818d88 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:02.928649 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aa2b95b7-1528-48bc-9ddf-2c2a8d818d88 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:02.929076 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aa2b95b7-1528-48bc-9ddf-2c2a8d818d88 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:02.947354 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-aa2b95b7-1528-48bc-9ddf-2c2a8d818d88 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Getting quotas for project ec5893d9a55f4ed28f6579397d0d6f21. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:39:02.952209 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-aa2b95b7-1528-48bc-9ddf-2c2a8d818d88 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Getting quotas for user 45422a67a78f4784abc0f18ad84778f3 and project ec5893d9a55f4ed28f6579397d0d6f21. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:39:02.964656 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-aa2b95b7-1528-48bc-9ddf-2c2a8d818d88 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Going to run 1 instances... {{(pid=128048) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:39:02.967266 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-aa2b95b7-1528-48bc-9ddf-2c2a8d818d88 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12947ed8-8ca9-442d-9224-509e79a198e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128048) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:39:03.074964 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-aa2b95b7-1528-48bc-9ddf-2c2a8d818d88 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.648692 Aug 31 00:39:03.075931 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 248/501] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:39:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:39:03.087862 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f4a4425a-a846-43b5-90a4-fb7ed867946b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:03.088606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f4a4425a-a846-43b5-90a4-fb7ed867946b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:03.143080 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f4a4425a-a846-43b5-90a4-fb7ed867946b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:03.151154 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f4a4425a-a846-43b5-90a4-fb7ed867946b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1242 microversion: 2.1 time: 0.067394 Aug 31 00:39:03.151722 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 254/502] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:03 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:03.333598 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-4c54c2db-2b0f-4932-b6f7-d47a2196391b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:03.334308 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-4c54c2db-2b0f-4932-b6f7-d47a2196391b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:03.340641 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4c54c2db-2b0f-4932-b6f7-d47a2196391b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:03.341191 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4c54c2db-2b0f-4932-b6f7-d47a2196391b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:03.341691 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4c54c2db-2b0f-4932-b6f7-d47a2196391b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:03.342443 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4c54c2db-2b0f-4932-b6f7-d47a2196391b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:03.342999 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4c54c2db-2b0f-4932-b6f7-d47a2196391b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:03.343485 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4c54c2db-2b0f-4932-b6f7-d47a2196391b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:03.481366 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4c54c2db-2b0f-4932-b6f7-d47a2196391b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:03.489892 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-4c54c2db-2b0f-4932-b6f7-d47a2196391b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1733 microversion: 2.1 time: 0.161109 Aug 31 00:39:03.490459 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 249/503] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:03 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:04.171159 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-bb125bfa-c83b-423b-81e0-d1ed8e56ade8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:04.171762 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-bb125bfa-c83b-423b-81e0-d1ed8e56ade8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:04.178772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bb125bfa-c83b-423b-81e0-d1ed8e56ade8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:04.179245 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bb125bfa-c83b-423b-81e0-d1ed8e56ade8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:04.179674 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bb125bfa-c83b-423b-81e0-d1ed8e56ade8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:04.180371 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bb125bfa-c83b-423b-81e0-d1ed8e56ade8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:04.180817 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bb125bfa-c83b-423b-81e0-d1ed8e56ade8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:04.181232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bb125bfa-c83b-423b-81e0-d1ed8e56ade8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:04.241526 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-bb125bfa-c83b-423b-81e0-d1ed8e56ade8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:04.249225 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-bb125bfa-c83b-423b-81e0-d1ed8e56ade8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1238 microversion: 2.1 time: 0.082004 Aug 31 00:39:04.249773 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 255/504] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:04 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:04.511388 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-09a0797e-c303-4f83-9fd6-7e8bbed50f23 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:04.512001 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-09a0797e-c303-4f83-9fd6-7e8bbed50f23 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:04.517971 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-09a0797e-c303-4f83-9fd6-7e8bbed50f23 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:04.518450 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-09a0797e-c303-4f83-9fd6-7e8bbed50f23 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:04.518883 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-09a0797e-c303-4f83-9fd6-7e8bbed50f23 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:04.519562 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-09a0797e-c303-4f83-9fd6-7e8bbed50f23 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:04.520677 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-09a0797e-c303-4f83-9fd6-7e8bbed50f23 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:04.521479 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-09a0797e-c303-4f83-9fd6-7e8bbed50f23 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:04.650522 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-09a0797e-c303-4f83-9fd6-7e8bbed50f23 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:04.658602 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-09a0797e-c303-4f83-9fd6-7e8bbed50f23 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1713 microversion: 2.1 time: 0.151086 Aug 31 00:39:04.659162 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 250/505] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:04 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:04.769736 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-019163ab-dfa8-4031-9d2d-955f740fd028 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:04.770829 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-019163ab-dfa8-4031-9d2d-955f740fd028 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:04.777279 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-019163ab-dfa8-4031-9d2d-955f740fd028 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:04.777754 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-019163ab-dfa8-4031-9d2d-955f740fd028 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:04.778184 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-019163ab-dfa8-4031-9d2d-955f740fd028 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:04.778864 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-019163ab-dfa8-4031-9d2d-955f740fd028 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:04.779358 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-019163ab-dfa8-4031-9d2d-955f740fd028 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:04.779779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-019163ab-dfa8-4031-9d2d-955f740fd028 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:04.914461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-019163ab-dfa8-4031-9d2d-955f740fd028 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] HTTP exception thrown: Cannot 'detach_volume' instance 95f8fa2f-7f69-4291-903c-1618b2c28146 while it is in vm_state rescued Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-019163ab-dfa8-4031-9d2d-955f740fd028 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Request method failure captured: Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: DELETE /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/os-volume_attachments/8609c323-46de-4af1-82be-cb10793250c9 HTTP/1.1 Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqyzEg2Mk_Qrf-4ucl5mTksNAq4yJwZyFBzvEgaG-5wDv2_jHH3xLzlf6obMgJH9KOGrXwUBwxa_Key6OaUOrEfJ-OUrg1I_ZHusiecer0qLWJfeK6Wzpvtw2fZKiIczmma4oKpwrpEcygSzKn_2orgSwt38-qdaeq_LONkjXnfIEKU Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: d8aa6e0e8e6b492f8e74eea0e830c0bc Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1041420977 Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:39:04.916063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:39:04.917634 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:39:04.917634 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1041420977 Aug 31 00:39:04.917634 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: d8aa6e0e8e6b492f8e74eea0e830c0bc Aug 31 00:39:04.917634 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1041420977 Aug 31 00:39:04.917634 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-ServerRescueNegativeTestJSON-1041420977-project Aug 31 00:39:04.917634 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:39:04.917634 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:39:04.917634 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 77d23c99308c414f939761b07d329e03 Aug 31 00:39:04.917634 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1041420977-project Aug 31 00:39:04.917634 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:39:04.917634 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Cannot 'detach_volume' instance 95f8fa2f-7f69-4291-903c-1618b2c28146 while it is in vm_state rescued Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'server_id': '95f8fa2f-7f69-4291-903c-1618b2c28146', 'id': '8609c323-46de-4af1-82be-cb10793250c9'} Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95f8fa2f-7f69-4291-903c-1618b2c28146 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:39:04.918409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:39:04.919834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 00:39:04.919834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 00:39:04.919834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 00:39:04.919834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 00:39:04.919834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 95f8fa2f-7f69-4291-903c-1618b2c28146 while it is in vm_state rescued Aug 31 00:39:04.919834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:39:04.919834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:39:04.919834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:39:04.919834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:39:04.919834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:39:04.919834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:39:04.919834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:39:04.919834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:39:04.919834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 95f8fa2f-7f69-4291-903c-1618b2c28146 while it is in vm_state rescued Aug 31 00:39:04.919834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:39:04.919834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-019163ab-dfa8-4031-9d2d-955f740fd028 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Returning 409 to user: Cannot 'detach_volume' instance 95f8fa2f-7f69-4291-903c-1618b2c28146 while it is in vm_state rescued {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:39:04.921081 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-019163ab-dfa8-4031-9d2d-955f740fd028 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "DELETE /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/os-volume_attachments/8609c323-46de-4af1-82be-cb10793250c9" status: 409 len: 152 microversion: 2.1 time: 0.151976 Aug 31 00:39:04.921460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 256/506] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 00:39:04 2022] DELETE /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/os-volume_attachments/8609c323-46de-4af1-82be-cb10793250c9 => generated 152 bytes in 156 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 00:39:04.927100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-88ae807e-f409-4009-9223-0ce23e5526c8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:04.927708 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-88ae807e-f409-4009-9223-0ce23e5526c8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:04.933733 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-88ae807e-f409-4009-9223-0ce23e5526c8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:04.934211 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-88ae807e-f409-4009-9223-0ce23e5526c8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:04.934643 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-88ae807e-f409-4009-9223-0ce23e5526c8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:04.938793 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-88ae807e-f409-4009-9223-0ce23e5526c8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:04.938793 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-88ae807e-f409-4009-9223-0ce23e5526c8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:04.938793 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-88ae807e-f409-4009-9223-0ce23e5526c8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:05.115381 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-88ae807e-f409-4009-9223-0ce23e5526c8 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "POST /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/action" status: 202 len: 0 microversion: 2.1 time: 0.192446 Aug 31 00:39:05.115947 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 251/507] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 00:39:04 2022] POST /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:39:05.125127 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6aff9e55-ff87-4f00-bdea-4c48089f192b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:05.126340 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6aff9e55-ff87-4f00-bdea-4c48089f192b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:05.132392 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6aff9e55-ff87-4f00-bdea-4c48089f192b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:05.132878 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6aff9e55-ff87-4f00-bdea-4c48089f192b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:05.133310 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6aff9e55-ff87-4f00-bdea-4c48089f192b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:05.133997 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6aff9e55-ff87-4f00-bdea-4c48089f192b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:05.134446 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6aff9e55-ff87-4f00-bdea-4c48089f192b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:05.134866 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6aff9e55-ff87-4f00-bdea-4c48089f192b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:05.276847 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9b2829e4-98c2-4830-a317-1b174e8cd42d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:05.277712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9b2829e4-98c2-4830-a317-1b174e8cd42d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:05.280283 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6aff9e55-ff87-4f00-bdea-4c48089f192b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:05.285660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9b2829e4-98c2-4830-a317-1b174e8cd42d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:05.286165 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9b2829e4-98c2-4830-a317-1b174e8cd42d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:05.286590 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9b2829e4-98c2-4830-a317-1b174e8cd42d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:05.287348 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9b2829e4-98c2-4830-a317-1b174e8cd42d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:05.287794 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9b2829e4-98c2-4830-a317-1b174e8cd42d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:05.288253 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9b2829e4-98c2-4830-a317-1b174e8cd42d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:05.291349 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6aff9e55-ff87-4f00-bdea-4c48089f192b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1721 microversion: 2.1 time: 0.170604 Aug 31 00:39:05.299860 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 257/508] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:05 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:05.383327 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-9b2829e4-98c2-4830-a317-1b174e8cd42d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:05.393113 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9b2829e4-98c2-4830-a317-1b174e8cd42d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1294 microversion: 2.1 time: 0.125232 Aug 31 00:39:05.396582 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 252/509] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:05 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1294 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:39:06.313950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-e20e11f2-173e-4cb7-bdbd-c3749b3896cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:06.314558 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-e20e11f2-173e-4cb7-bdbd-c3749b3896cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:06.323891 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e20e11f2-173e-4cb7-bdbd-c3749b3896cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:06.324508 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e20e11f2-173e-4cb7-bdbd-c3749b3896cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:06.325088 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e20e11f2-173e-4cb7-bdbd-c3749b3896cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:06.325842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e20e11f2-173e-4cb7-bdbd-c3749b3896cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:06.326359 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e20e11f2-173e-4cb7-bdbd-c3749b3896cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:06.326996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e20e11f2-173e-4cb7-bdbd-c3749b3896cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:06.416772 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f00a77b1-6fab-4eb4-926a-7f3b2bb8d550 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:06.420114 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-f00a77b1-6fab-4eb4-926a-7f3b2bb8d550 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:06.427481 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f00a77b1-6fab-4eb4-926a-7f3b2bb8d550 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:06.428045 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f00a77b1-6fab-4eb4-926a-7f3b2bb8d550 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:06.428699 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f00a77b1-6fab-4eb4-926a-7f3b2bb8d550 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:06.429604 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f00a77b1-6fab-4eb4-926a-7f3b2bb8d550 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:06.430224 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f00a77b1-6fab-4eb4-926a-7f3b2bb8d550 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:06.430655 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f00a77b1-6fab-4eb4-926a-7f3b2bb8d550 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:06.465983 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-e20e11f2-173e-4cb7-bdbd-c3749b3896cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:06.475453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-e20e11f2-173e-4cb7-bdbd-c3749b3896cf tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1721 microversion: 2.1 time: 0.165447 Aug 31 00:39:06.476033 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 258/510] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:06 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:06.498699 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f00a77b1-6fab-4eb4-926a-7f3b2bb8d550 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:06.506697 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f00a77b1-6fab-4eb4-926a-7f3b2bb8d550 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1300 microversion: 2.1 time: 0.093733 Aug 31 00:39:06.507262 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 253/511] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:06 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:07.496586 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b48c2271-d992-441a-8977-b60e926fc3b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:07.497197 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-b48c2271-d992-441a-8977-b60e926fc3b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:07.503632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b48c2271-d992-441a-8977-b60e926fc3b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:07.504116 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b48c2271-d992-441a-8977-b60e926fc3b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:07.505239 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b48c2271-d992-441a-8977-b60e926fc3b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:07.505931 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b48c2271-d992-441a-8977-b60e926fc3b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:07.506418 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b48c2271-d992-441a-8977-b60e926fc3b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:07.506846 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b48c2271-d992-441a-8977-b60e926fc3b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:07.533330 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-53d88317-2ac3-44ff-be81-9e7ab7b24cc3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:07.534038 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-53d88317-2ac3-44ff-be81-9e7ab7b24cc3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:07.551597 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-53d88317-2ac3-44ff-be81-9e7ab7b24cc3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:07.552426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-53d88317-2ac3-44ff-be81-9e7ab7b24cc3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:07.552879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-53d88317-2ac3-44ff-be81-9e7ab7b24cc3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:07.553604 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-53d88317-2ac3-44ff-be81-9e7ab7b24cc3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:07.554051 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-53d88317-2ac3-44ff-be81-9e7ab7b24cc3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:07.554472 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-53d88317-2ac3-44ff-be81-9e7ab7b24cc3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:07.644049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-b48c2271-d992-441a-8977-b60e926fc3b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:07.647701 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=100 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:07.654529 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-b48c2271-d992-441a-8977-b60e926fc3b9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1721 microversion: 2.1 time: 0.161797 Aug 31 00:39:07.655102 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 259/512] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:07 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:07.689198 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-53d88317-2ac3-44ff-be81-9e7ab7b24cc3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:07.697625 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-53d88317-2ac3-44ff-be81-9e7ab7b24cc3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1368 microversion: 2.1 time: 0.168128 Aug 31 00:39:07.698184 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 254/513] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:07 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:39:08.566209 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-1a8a1056-64ea-4632-bdd6-8c7a23c1f020 req-39e2e4ec-54bd-4fc6-8495-94e512c4270d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24bd8f41-5ce3-4260-bd3e-d98a55817bfd", "tag": "b850ca23-da95-4ccb-9aff-d53185c76064"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:08.576930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-1a8a1056-64ea-4632-bdd6-8c7a23c1f020 req-39e2e4ec-54bd-4fc6-8495-94e512c4270d service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:08.577656 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-1a8a1056-64ea-4632-bdd6-8c7a23c1f020 req-39e2e4ec-54bd-4fc6-8495-94e512c4270d service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:08.577896 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-1a8a1056-64ea-4632-bdd6-8c7a23c1f020 req-39e2e4ec-54bd-4fc6-8495-94e512c4270d service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:08.589345 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-1a8a1056-64ea-4632-bdd6-8c7a23c1f020 req-39e2e4ec-54bd-4fc6-8495-94e512c4270d service nova] Creating event network-changed:b850ca23-da95-4ccb-9aff-d53185c76064 for instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd on hv-cinder-85221 Aug 31 00:39:08.594273 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-1a8a1056-64ea-4632-bdd6-8c7a23c1f020 req-39e2e4ec-54bd-4fc6-8495-94e512c4270d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035904 Aug 31 00:39:08.595126 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 260/514] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:08.676397 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-e6e92bc3-4770-4c7b-b21e-a87f49772d83 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:08.677116 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-e6e92bc3-4770-4c7b-b21e-a87f49772d83 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:08.683297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e6e92bc3-4770-4c7b-b21e-a87f49772d83 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:08.683779 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e6e92bc3-4770-4c7b-b21e-a87f49772d83 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:08.684218 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e6e92bc3-4770-4c7b-b21e-a87f49772d83 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:08.684939 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e6e92bc3-4770-4c7b-b21e-a87f49772d83 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:08.685390 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e6e92bc3-4770-4c7b-b21e-a87f49772d83 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:08.685895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e6e92bc3-4770-4c7b-b21e-a87f49772d83 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:08.719918 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-722e0124-a72c-408c-8793-6c4278b67318 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:08.720802 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-722e0124-a72c-408c-8793-6c4278b67318 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:08.727983 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-722e0124-a72c-408c-8793-6c4278b67318 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:08.728502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-722e0124-a72c-408c-8793-6c4278b67318 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:08.728936 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-722e0124-a72c-408c-8793-6c4278b67318 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:08.729620 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-722e0124-a72c-408c-8793-6c4278b67318 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:08.730089 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-722e0124-a72c-408c-8793-6c4278b67318 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:08.730511 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-722e0124-a72c-408c-8793-6c4278b67318 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:08.868595 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-e6e92bc3-4770-4c7b-b21e-a87f49772d83 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:08.877026 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-e6e92bc3-4770-4c7b-b21e-a87f49772d83 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1727 microversion: 2.1 time: 0.204571 Aug 31 00:39:08.877825 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 255/515] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:08 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1727 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:08.886438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-722e0124-a72c-408c-8793-6c4278b67318 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:08.895916 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-722e0124-a72c-408c-8793-6c4278b67318 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1368 microversion: 2.1 time: 0.179493 Aug 31 00:39:08.896665 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 261/516] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:08 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:39:08.900085 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f6e77199-b8b0-4758-946f-8f6371fea4a1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:08.900663 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-f6e77199-b8b0-4758-946f-8f6371fea4a1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:08.906554 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f6e77199-b8b0-4758-946f-8f6371fea4a1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:08.907034 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f6e77199-b8b0-4758-946f-8f6371fea4a1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:08.907467 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f6e77199-b8b0-4758-946f-8f6371fea4a1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:08.908162 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f6e77199-b8b0-4758-946f-8f6371fea4a1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:08.908656 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f6e77199-b8b0-4758-946f-8f6371fea4a1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:08.909319 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f6e77199-b8b0-4758-946f-8f6371fea4a1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:08.924160 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:09.009678 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f6e77199-b8b0-4758-946f-8f6371fea4a1 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114660 Aug 31 00:39:09.010270 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 256/517] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 31 00:39:08 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:09.920886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-9625e65b-4bf0-4bb3-b322-5e3b82fa4a97 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:09.921723 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-9625e65b-4bf0-4bb3-b322-5e3b82fa4a97 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:09.929304 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9625e65b-4bf0-4bb3-b322-5e3b82fa4a97 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:09.929878 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9625e65b-4bf0-4bb3-b322-5e3b82fa4a97 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:09.932970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9625e65b-4bf0-4bb3-b322-5e3b82fa4a97 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:09.932970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9625e65b-4bf0-4bb3-b322-5e3b82fa4a97 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:09.932970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9625e65b-4bf0-4bb3-b322-5e3b82fa4a97 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:09.932970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9625e65b-4bf0-4bb3-b322-5e3b82fa4a97 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:10.153395 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-9625e65b-4bf0-4bb3-b322-5e3b82fa4a97 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:10.161934 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-9625e65b-4bf0-4bb3-b322-5e3b82fa4a97 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1368 microversion: 2.1 time: 0.245000 Aug 31 00:39:10.162519 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 262/518] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:09 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1368 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:10.268117 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-3d6825ca-a43b-4704-9c57-5ef56567be2f req-c04907aa-56c5-4045-9ec8-a8f7b8f1a32e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f8fa2f-7f69-4291-903c-1618b2c28146", "tag": "28ac27c8-3511-439e-b159-a7d7f843ea7b"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:10.281004 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-3d6825ca-a43b-4704-9c57-5ef56567be2f req-c04907aa-56c5-4045-9ec8-a8f7b8f1a32e service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:10.281821 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-3d6825ca-a43b-4704-9c57-5ef56567be2f req-c04907aa-56c5-4045-9ec8-a8f7b8f1a32e service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:10.282348 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-3d6825ca-a43b-4704-9c57-5ef56567be2f req-c04907aa-56c5-4045-9ec8-a8f7b8f1a32e service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:10.295708 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-3d6825ca-a43b-4704-9c57-5ef56567be2f req-c04907aa-56c5-4045-9ec8-a8f7b8f1a32e service nova] Creating event network-changed:28ac27c8-3511-439e-b159-a7d7f843ea7b for instance 95f8fa2f-7f69-4291-903c-1618b2c28146 on hv-cinder-85221 Aug 31 00:39:10.302779 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-3d6825ca-a43b-4704-9c57-5ef56567be2f req-c04907aa-56c5-4045-9ec8-a8f7b8f1a32e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036891 Aug 31 00:39:10.302779 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 257/519] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:10.998437 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c5aa197a-65a3-48bb-a43e-ff58925e6cad tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:10.999040 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c5aa197a-65a3-48bb-a43e-ff58925e6cad tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:11.006580 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c5aa197a-65a3-48bb-a43e-ff58925e6cad tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:11.007065 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c5aa197a-65a3-48bb-a43e-ff58925e6cad tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:11.007496 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c5aa197a-65a3-48bb-a43e-ff58925e6cad tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:11.008193 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c5aa197a-65a3-48bb-a43e-ff58925e6cad tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:11.008671 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c5aa197a-65a3-48bb-a43e-ff58925e6cad tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:11.009094 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c5aa197a-65a3-48bb-a43e-ff58925e6cad tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:11.046489 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c5aa197a-65a3-48bb-a43e-ff58925e6cad tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/os-volume_attachments/da73a060-befd-464a-9d40-67d753756757" status: 200 len: 194 microversion: 2.20 time: 0.052032 Aug 31 00:39:11.053363 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 263/520] 10.222.0.65 () {60 vars in 1454 bytes} [Wed Aug 31 00:39:10 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/os-volume_attachments/da73a060-befd-464a-9d40-67d753756757 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:11.143291 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c15cdaf2-fb55-4de7-8235-b666b451e48d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:11.144273 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c15cdaf2-fb55-4de7-8235-b666b451e48d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:11.154947 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c15cdaf2-fb55-4de7-8235-b666b451e48d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:11.155761 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c15cdaf2-fb55-4de7-8235-b666b451e48d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:11.156464 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c15cdaf2-fb55-4de7-8235-b666b451e48d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:11.157247 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c15cdaf2-fb55-4de7-8235-b666b451e48d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:11.157870 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c15cdaf2-fb55-4de7-8235-b666b451e48d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:11.158496 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c15cdaf2-fb55-4de7-8235-b666b451e48d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:11.189877 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6625dfb7-b5d9-45cf-ae18-907e892caa28 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:11.191498 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6625dfb7-b5d9-45cf-ae18-907e892caa28 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:11.203703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6625dfb7-b5d9-45cf-ae18-907e892caa28 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:11.204511 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6625dfb7-b5d9-45cf-ae18-907e892caa28 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:11.205843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6625dfb7-b5d9-45cf-ae18-907e892caa28 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:11.209704 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6625dfb7-b5d9-45cf-ae18-907e892caa28 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:11.210198 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6625dfb7-b5d9-45cf-ae18-907e892caa28 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:11.210610 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6625dfb7-b5d9-45cf-ae18-907e892caa28 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:11.276498 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-c15cdaf2-fb55-4de7-8235-b666b451e48d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lazy-loading 'services' on Instance uuid dfc3d686-f358-4b8f-b983-984fd54e31e1 {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:39:11.383702 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6625dfb7-b5d9-45cf-ae18-907e892caa28 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:11.391668 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6625dfb7-b5d9-45cf-ae18-907e892caa28 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1368 microversion: 2.1 time: 0.211726 Aug 31 00:39:11.392228 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 264/521] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:11 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:39:11.524453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-c15cdaf2-fb55-4de7-8235-b666b451e48d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "DELETE /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/os-volume_attachments/da73a060-befd-464a-9d40-67d753756757" status: 202 len: 0 microversion: 2.20 time: 0.389827 Aug 31 00:39:11.525164 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 258/522] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Aug 31 00:39:11 2022] DELETE /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/os-volume_attachments/da73a060-befd-464a-9d40-67d753756757 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:39:11.533469 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-5ffb0f15-9d9c-4c05-b561-ddf638a75021 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:11.535711 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-5ffb0f15-9d9c-4c05-b561-ddf638a75021 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:11.544997 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5ffb0f15-9d9c-4c05-b561-ddf638a75021 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:11.545485 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5ffb0f15-9d9c-4c05-b561-ddf638a75021 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:11.545918 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5ffb0f15-9d9c-4c05-b561-ddf638a75021 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:11.546616 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5ffb0f15-9d9c-4c05-b561-ddf638a75021 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:11.547061 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5ffb0f15-9d9c-4c05-b561-ddf638a75021 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:11.547485 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5ffb0f15-9d9c-4c05-b561-ddf638a75021 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:11.583386 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-5ffb0f15-9d9c-4c05-b561-ddf638a75021 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053237 Aug 31 00:39:11.583998 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 265/523] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:11 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:12.317647 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-db189284-b343-4aad-827f-f813bd0562fa req-1d10783a-878e-435d-9909-2408e7f44c53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f8fa2f-7f69-4291-903c-1618b2c28146", "tag": "28ac27c8-3511-439e-b159-a7d7f843ea7b"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:12.327617 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-db189284-b343-4aad-827f-f813bd0562fa req-1d10783a-878e-435d-9909-2408e7f44c53 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:12.328089 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-db189284-b343-4aad-827f-f813bd0562fa req-1d10783a-878e-435d-9909-2408e7f44c53 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:12.328547 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-db189284-b343-4aad-827f-f813bd0562fa req-1d10783a-878e-435d-9909-2408e7f44c53 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:12.340785 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-db189284-b343-4aad-827f-f813bd0562fa req-1d10783a-878e-435d-9909-2408e7f44c53 service nova] Creating event network-changed:28ac27c8-3511-439e-b159-a7d7f843ea7b for instance 95f8fa2f-7f69-4291-903c-1618b2c28146 on hv-cinder-85221 Aug 31 00:39:12.345622 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-db189284-b343-4aad-827f-f813bd0562fa req-1d10783a-878e-435d-9909-2408e7f44c53 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032724 Aug 31 00:39:12.346209 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 259/524] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:12.414922 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-bfbdb531-2647-442d-a8c0-cd41fca9ecd2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:12.415595 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-bfbdb531-2647-442d-a8c0-cd41fca9ecd2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:12.429739 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bfbdb531-2647-442d-a8c0-cd41fca9ecd2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:12.430391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bfbdb531-2647-442d-a8c0-cd41fca9ecd2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:12.430931 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bfbdb531-2647-442d-a8c0-cd41fca9ecd2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:12.431748 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bfbdb531-2647-442d-a8c0-cd41fca9ecd2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:12.432295 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bfbdb531-2647-442d-a8c0-cd41fca9ecd2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:12.432819 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bfbdb531-2647-442d-a8c0-cd41fca9ecd2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:12.585638 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-bfbdb531-2647-442d-a8c0-cd41fca9ecd2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:12.595756 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-bfbdb531-2647-442d-a8c0-cd41fca9ecd2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1368 microversion: 2.1 time: 0.185275 Aug 31 00:39:12.596083 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-4a4a4f58-1626-4fe4-b8d8-313e849ba969 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:12.599396 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 266/525] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:12 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:12.599512 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-4a4a4f58-1626-4fe4-b8d8-313e849ba969 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:12.605734 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4a4a4f58-1626-4fe4-b8d8-313e849ba969 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:12.606338 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4a4a4f58-1626-4fe4-b8d8-313e849ba969 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:12.606775 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4a4a4f58-1626-4fe4-b8d8-313e849ba969 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:12.607471 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4a4a4f58-1626-4fe4-b8d8-313e849ba969 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:12.607925 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4a4a4f58-1626-4fe4-b8d8-313e849ba969 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:12.608366 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4a4a4f58-1626-4fe4-b8d8-313e849ba969 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:12.642572 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-4a4a4f58-1626-4fe4-b8d8-313e849ba969 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051027 Aug 31 00:39:12.643153 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 260/526] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:12 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 00:39:13.618287 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f9e1cde0-8e70-4961-8696-edaef9d5f7dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:13.618951 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f9e1cde0-8e70-4961-8696-edaef9d5f7dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:13.620864 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=6 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:13.626276 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9e1cde0-8e70-4961-8696-edaef9d5f7dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:13.626753 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9e1cde0-8e70-4961-8696-edaef9d5f7dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:13.627182 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9e1cde0-8e70-4961-8696-edaef9d5f7dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:13.627871 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9e1cde0-8e70-4961-8696-edaef9d5f7dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:13.628432 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9e1cde0-8e70-4961-8696-edaef9d5f7dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:13.634882 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9e1cde0-8e70-4961-8696-edaef9d5f7dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:13.652773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:13.653798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=6 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:13.659253 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-0e5dda51-0da6-41b1-8f1b-17704e414684 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:13.661632 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-0e5dda51-0da6-41b1-8f1b-17704e414684 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:13.668574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0e5dda51-0da6-41b1-8f1b-17704e414684 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:13.669232 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0e5dda51-0da6-41b1-8f1b-17704e414684 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:13.669675 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0e5dda51-0da6-41b1-8f1b-17704e414684 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:13.670426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0e5dda51-0da6-41b1-8f1b-17704e414684 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:13.670874 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0e5dda51-0da6-41b1-8f1b-17704e414684 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:13.671283 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0e5dda51-0da6-41b1-8f1b-17704e414684 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:13.711782 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-0e5dda51-0da6-41b1-8f1b-17704e414684 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059772 Aug 31 00:39:13.712376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 261/527] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 31 00:39:13 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:39:13.776214 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f9e1cde0-8e70-4961-8696-edaef9d5f7dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:13.778723 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c31c632e-ac95-4087-9fb3-df8692aae296 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:13.779239 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c31c632e-ac95-4087-9fb3-df8692aae296 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:13.783904 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f9e1cde0-8e70-4961-8696-edaef9d5f7dd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1368 microversion: 2.1 time: 0.169806 Aug 31 00:39:13.784602 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 267/528] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:13 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:13.786272 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c31c632e-ac95-4087-9fb3-df8692aae296 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:13.786758 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c31c632e-ac95-4087-9fb3-df8692aae296 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:13.787186 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c31c632e-ac95-4087-9fb3-df8692aae296 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:13.788087 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c31c632e-ac95-4087-9fb3-df8692aae296 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:13.789344 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c31c632e-ac95-4087-9fb3-df8692aae296 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:13.789808 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c31c632e-ac95-4087-9fb3-df8692aae296 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:13.818319 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c31c632e-ac95-4087-9fb3-df8692aae296 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Going to try to terminate instance {{(pid=128048) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:39:14.134545 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-c31c632e-ac95-4087-9fb3-df8692aae296 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "DELETE /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 204 len: 0 microversion: 2.20 time: 0.359667 Aug 31 00:39:14.135150 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 262/529] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 31 00:39:13 2022] DELETE /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 31 00:39:14.143380 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-babf5028-f39f-478c-aa3c-e3158a877464 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:14.144098 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-babf5028-f39f-478c-aa3c-e3158a877464 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:14.151618 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-babf5028-f39f-478c-aa3c-e3158a877464 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:14.152133 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-babf5028-f39f-478c-aa3c-e3158a877464 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:14.152605 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-babf5028-f39f-478c-aa3c-e3158a877464 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:14.153304 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-babf5028-f39f-478c-aa3c-e3158a877464 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:14.153749 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-babf5028-f39f-478c-aa3c-e3158a877464 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:14.154169 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-babf5028-f39f-478c-aa3c-e3158a877464 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:14.290352 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-babf5028-f39f-478c-aa3c-e3158a877464 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:14.298674 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-babf5028-f39f-478c-aa3c-e3158a877464 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:14.300140 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-babf5028-f39f-478c-aa3c-e3158a877464 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:14.301446 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-babf5028-f39f-478c-aa3c-e3158a877464 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1723 microversion: 2.20 time: 0.161856 Aug 31 00:39:14.302013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 268/530] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:14 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:39:14.807127 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-21071df8-2cef-4042-b50b-94fa89672962 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:14.807820 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-21071df8-2cef-4042-b50b-94fa89672962 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:14.813797 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-21071df8-2cef-4042-b50b-94fa89672962 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:14.814277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-21071df8-2cef-4042-b50b-94fa89672962 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:14.814710 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-21071df8-2cef-4042-b50b-94fa89672962 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:14.815394 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-21071df8-2cef-4042-b50b-94fa89672962 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:14.815845 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-21071df8-2cef-4042-b50b-94fa89672962 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:14.816265 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-21071df8-2cef-4042-b50b-94fa89672962 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:14.953339 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-21071df8-2cef-4042-b50b-94fa89672962 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:14.961754 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-21071df8-2cef-4042-b50b-94fa89672962 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1368 microversion: 2.1 time: 0.158872 Aug 31 00:39:14.962325 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 263/531] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:14 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:15.325389 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-85d9daf6-5cab-46b1-8cac-3d3243c4a026 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:15.326030 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-85d9daf6-5cab-46b1-8cac-3d3243c4a026 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:15.333378 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-85d9daf6-5cab-46b1-8cac-3d3243c4a026 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:15.333851 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-85d9daf6-5cab-46b1-8cac-3d3243c4a026 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:15.334281 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-85d9daf6-5cab-46b1-8cac-3d3243c4a026 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:15.334970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-85d9daf6-5cab-46b1-8cac-3d3243c4a026 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:15.335424 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-85d9daf6-5cab-46b1-8cac-3d3243c4a026 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:15.335847 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-85d9daf6-5cab-46b1-8cac-3d3243c4a026 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:15.475488 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-85d9daf6-5cab-46b1-8cac-3d3243c4a026 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:15.484185 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-85d9daf6-5cab-46b1-8cac-3d3243c4a026 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:15.485947 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-85d9daf6-5cab-46b1-8cac-3d3243c4a026 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:15.487203 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-85d9daf6-5cab-46b1-8cac-3d3243c4a026 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1723 microversion: 2.20 time: 0.165799 Aug 31 00:39:15.487708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 269/532] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:15 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:39:15.747804 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-234a8256-f4b7-4ee1-84f9-fd3f0542af4d req-fbb4d16b-f7c1-4bfa-811c-dc92553178d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24bd8f41-5ce3-4260-bd3e-d98a55817bfd", "name": "network-vif-plugged", "status": "completed", "tag": "b850ca23-da95-4ccb-9aff-d53185c76064"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:15.758460 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-234a8256-f4b7-4ee1-84f9-fd3f0542af4d req-fbb4d16b-f7c1-4bfa-811c-dc92553178d8 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:15.759041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-234a8256-f4b7-4ee1-84f9-fd3f0542af4d req-fbb4d16b-f7c1-4bfa-811c-dc92553178d8 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:15.759547 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-234a8256-f4b7-4ee1-84f9-fd3f0542af4d req-fbb4d16b-f7c1-4bfa-811c-dc92553178d8 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:15.771558 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-234a8256-f4b7-4ee1-84f9-fd3f0542af4d req-fbb4d16b-f7c1-4bfa-811c-dc92553178d8 service nova] Creating event network-vif-plugged:b850ca23-da95-4ccb-9aff-d53185c76064 for instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd on hv-cinder-85221 Aug 31 00:39:15.776948 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-234a8256-f4b7-4ee1-84f9-fd3f0542af4d req-fbb4d16b-f7c1-4bfa-811c-dc92553178d8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033048 Aug 31 00:39:15.777707 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 264/533] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:15.983083 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-66a90873-d5a1-4c08-8976-f2e28a1e190f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:15.983692 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-66a90873-d5a1-4c08-8976-f2e28a1e190f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:15.990332 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-66a90873-d5a1-4c08-8976-f2e28a1e190f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:15.991081 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-66a90873-d5a1-4c08-8976-f2e28a1e190f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:15.991543 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-66a90873-d5a1-4c08-8976-f2e28a1e190f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:15.992245 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-66a90873-d5a1-4c08-8976-f2e28a1e190f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:15.992726 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-66a90873-d5a1-4c08-8976-f2e28a1e190f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:15.993143 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-66a90873-d5a1-4c08-8976-f2e28a1e190f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:16.131205 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-66a90873-d5a1-4c08-8976-f2e28a1e190f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:16.139413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-66a90873-d5a1-4c08-8976-f2e28a1e190f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1368 microversion: 2.1 time: 0.160130 Aug 31 00:39:16.139927 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 270/534] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:15 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:16.512511 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-be3b06e1-e74d-4ec5-8234-ab3b7ee32368 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:16.513203 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-be3b06e1-e74d-4ec5-8234-ab3b7ee32368 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:16.519323 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-be3b06e1-e74d-4ec5-8234-ab3b7ee32368 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:16.519802 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-be3b06e1-e74d-4ec5-8234-ab3b7ee32368 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:16.520236 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-be3b06e1-e74d-4ec5-8234-ab3b7ee32368 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:16.521719 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-be3b06e1-e74d-4ec5-8234-ab3b7ee32368 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:16.522223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-be3b06e1-e74d-4ec5-8234-ab3b7ee32368 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:16.522650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-be3b06e1-e74d-4ec5-8234-ab3b7ee32368 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:16.748151 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-be3b06e1-e74d-4ec5-8234-ab3b7ee32368 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:16.756933 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-be3b06e1-e74d-4ec5-8234-ab3b7ee32368 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:16.758399 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-be3b06e1-e74d-4ec5-8234-ab3b7ee32368 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:16.759555 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-be3b06e1-e74d-4ec5-8234-ab3b7ee32368 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1723 microversion: 2.20 time: 0.251449 Aug 31 00:39:16.760115 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 265/535] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:16 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:39:17.163986 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-7c60b24b-d7c6-4e8d-a0b0-c008b8f50bad tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:17.163986 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-7c60b24b-d7c6-4e8d-a0b0-c008b8f50bad tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:17.170266 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7c60b24b-d7c6-4e8d-a0b0-c008b8f50bad tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:17.171425 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7c60b24b-d7c6-4e8d-a0b0-c008b8f50bad tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:17.171975 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7c60b24b-d7c6-4e8d-a0b0-c008b8f50bad tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:17.172817 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7c60b24b-d7c6-4e8d-a0b0-c008b8f50bad tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:17.173816 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7c60b24b-d7c6-4e8d-a0b0-c008b8f50bad tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:17.174219 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7c60b24b-d7c6-4e8d-a0b0-c008b8f50bad tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:17.180503 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-17778312-6238-436a-814f-5b5fabb2ec3c req-77376241-9d4b-4b18-a5cc-0638c4d643e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc3d686-f358-4b8f-b983-984fd54e31e1", "name": "network-vif-deleted", "tag": "e469ed11-88fc-4e04-ad53-fa40c91854d5"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:17.190007 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-17778312-6238-436a-814f-5b5fabb2ec3c req-77376241-9d4b-4b18-a5cc-0638c4d643e2 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:17.190562 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-17778312-6238-436a-814f-5b5fabb2ec3c req-77376241-9d4b-4b18-a5cc-0638c4d643e2 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:17.190899 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-17778312-6238-436a-814f-5b5fabb2ec3c req-77376241-9d4b-4b18-a5cc-0638c4d643e2 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:17.202959 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-17778312-6238-436a-814f-5b5fabb2ec3c req-77376241-9d4b-4b18-a5cc-0638c4d643e2 service nova] Creating event network-vif-deleted:e469ed11-88fc-4e04-ad53-fa40c91854d5 for instance dfc3d686-f358-4b8f-b983-984fd54e31e1 on hv-cinder-85221 Aug 31 00:39:17.207930 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-17778312-6238-436a-814f-5b5fabb2ec3c req-77376241-9d4b-4b18-a5cc-0638c4d643e2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031172 Aug 31 00:39:17.209354 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 266/536] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:17.335393 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7c60b24b-d7c6-4e8d-a0b0-c008b8f50bad tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:17.344770 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-7c60b24b-d7c6-4e8d-a0b0-c008b8f50bad tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1368 microversion: 2.1 time: 0.187170 Aug 31 00:39:17.345376 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 271/537] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:17 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:17.789291 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-3a7d2f88-ff68-404d-b83d-2a3d7f32de8f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:17.789977 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-3a7d2f88-ff68-404d-b83d-2a3d7f32de8f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:17.796121 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3a7d2f88-ff68-404d-b83d-2a3d7f32de8f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:17.796634 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3a7d2f88-ff68-404d-b83d-2a3d7f32de8f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:17.797060 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3a7d2f88-ff68-404d-b83d-2a3d7f32de8f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:17.797751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3a7d2f88-ff68-404d-b83d-2a3d7f32de8f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:17.798194 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3a7d2f88-ff68-404d-b83d-2a3d7f32de8f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:17.798611 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3a7d2f88-ff68-404d-b83d-2a3d7f32de8f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:17.835810 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3a7d2f88-ff68-404d-b83d-2a3d7f32de8f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:17.836198 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3a7d2f88-ff68-404d-b83d-2a3d7f32de8f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:17.836700 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3a7d2f88-ff68-404d-b83d-2a3d7f32de8f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:17.837150 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-3a7d2f88-ff68-404d-b83d-2a3d7f32de8f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lazy-loading 'fault' on Instance uuid dfc3d686-f358-4b8f-b983-984fd54e31e1 {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:39:17.889561 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-3a7d2f88-ff68-404d-b83d-2a3d7f32de8f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:17.899212 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-3a7d2f88-ff68-404d-b83d-2a3d7f32de8f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:17.900864 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-3a7d2f88-ff68-404d-b83d-2a3d7f32de8f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:17.902020 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-3a7d2f88-ff68-404d-b83d-2a3d7f32de8f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1371 microversion: 2.20 time: 0.117045 Aug 31 00:39:17.902588 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 267/538] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:17 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:39:18.374710 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-406b8dc8-4052-4322-a60f-b004ad0f6d50 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:18.375605 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-406b8dc8-4052-4322-a60f-b004ad0f6d50 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:18.388426 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-406b8dc8-4052-4322-a60f-b004ad0f6d50 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:18.388426 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-406b8dc8-4052-4322-a60f-b004ad0f6d50 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:18.388426 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-406b8dc8-4052-4322-a60f-b004ad0f6d50 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:18.388851 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-406b8dc8-4052-4322-a60f-b004ad0f6d50 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:18.389605 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-406b8dc8-4052-4322-a60f-b004ad0f6d50 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:18.390318 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-406b8dc8-4052-4322-a60f-b004ad0f6d50 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:18.535398 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-406b8dc8-4052-4322-a60f-b004ad0f6d50 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:18.544396 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-406b8dc8-4052-4322-a60f-b004ad0f6d50 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1557 microversion: 2.1 time: 0.176218 Aug 31 00:39:18.544965 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 272/539] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:18 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:18.565380 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-1545cfaa-97dc-41f5-a7d1-09c5bf1dd546 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:18.565859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-1545cfaa-97dc-41f5-a7d1-09c5bf1dd546 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:18.572799 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1545cfaa-97dc-41f5-a7d1-09c5bf1dd546 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:18.573271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1545cfaa-97dc-41f5-a7d1-09c5bf1dd546 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:18.573694 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1545cfaa-97dc-41f5-a7d1-09c5bf1dd546 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:18.574375 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1545cfaa-97dc-41f5-a7d1-09c5bf1dd546 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:18.574817 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1545cfaa-97dc-41f5-a7d1-09c5bf1dd546 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:18.575236 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1545cfaa-97dc-41f5-a7d1-09c5bf1dd546 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:18.659753 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-1545cfaa-97dc-41f5-a7d1-09c5bf1dd546 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098198 Aug 31 00:39:18.660487 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 268/540] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 31 00:39:18 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:18.926128 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4555f1b2-0f68-4062-9835-b7588d8d5012 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:18.928013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4555f1b2-0f68-4062-9835-b7588d8d5012 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:18.930805 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:18.936161 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4555f1b2-0f68-4062-9835-b7588d8d5012 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:18.942437 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4555f1b2-0f68-4062-9835-b7588d8d5012 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:18.942437 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4555f1b2-0f68-4062-9835-b7588d8d5012 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:18.942437 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4555f1b2-0f68-4062-9835-b7588d8d5012 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:18.942437 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4555f1b2-0f68-4062-9835-b7588d8d5012 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:18.943015 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4555f1b2-0f68-4062-9835-b7588d8d5012 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:18.974245 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4555f1b2-0f68-4062-9835-b7588d8d5012 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:18.975048 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4555f1b2-0f68-4062-9835-b7588d8d5012 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:18.975709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4555f1b2-0f68-4062-9835-b7588d8d5012 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:18.976219 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-4555f1b2-0f68-4062-9835-b7588d8d5012 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lazy-loading 'fault' on Instance uuid dfc3d686-f358-4b8f-b983-984fd54e31e1 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:39:19.047408 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4555f1b2-0f68-4062-9835-b7588d8d5012 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:19.056586 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4555f1b2-0f68-4062-9835-b7588d8d5012 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:19.058022 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4555f1b2-0f68-4062-9835-b7588d8d5012 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:19.059185 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4555f1b2-0f68-4062-9835-b7588d8d5012 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 200 len: 1371 microversion: 2.20 time: 0.138025 Aug 31 00:39:19.059747 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 273/541] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:18 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 1371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:39:19.734357 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-a369869a-b704-4b98-9878-5309439c45c2 req-170e6087-0e35-4e98-85cf-f985e1187722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24bd8f41-5ce3-4260-bd3e-d98a55817bfd", "tag": "b850ca23-da95-4ccb-9aff-d53185c76064"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:19.744696 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-a369869a-b704-4b98-9878-5309439c45c2 req-170e6087-0e35-4e98-85cf-f985e1187722 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:19.745379 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-a369869a-b704-4b98-9878-5309439c45c2 req-170e6087-0e35-4e98-85cf-f985e1187722 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:19.745617 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-a369869a-b704-4b98-9878-5309439c45c2 req-170e6087-0e35-4e98-85cf-f985e1187722 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:19.757243 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-a369869a-b704-4b98-9878-5309439c45c2 req-170e6087-0e35-4e98-85cf-f985e1187722 service nova] Creating event network-changed:b850ca23-da95-4ccb-9aff-d53185c76064 for instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd on hv-cinder-85221 Aug 31 00:39:19.762410 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-a369869a-b704-4b98-9878-5309439c45c2 req-170e6087-0e35-4e98-85cf-f985e1187722 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031891 Aug 31 00:39:19.763174 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 269/542] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:20.083704 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-fe15cc5b-b3a4-47c6-9cfe-54200198ef39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:20.085396 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-fe15cc5b-b3a4-47c6-9cfe-54200198ef39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:20.093025 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fe15cc5b-b3a4-47c6-9cfe-54200198ef39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:20.095348 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fe15cc5b-b3a4-47c6-9cfe-54200198ef39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:20.095348 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fe15cc5b-b3a4-47c6-9cfe-54200198ef39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:20.095348 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fe15cc5b-b3a4-47c6-9cfe-54200198ef39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:20.096477 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fe15cc5b-b3a4-47c6-9cfe-54200198ef39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:20.097282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fe15cc5b-b3a4-47c6-9cfe-54200198ef39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:20.121683 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-fe15cc5b-b3a4-47c6-9cfe-54200198ef39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] HTTP exception thrown: Instance dfc3d686-f358-4b8f-b983-984fd54e31e1 could not be found. Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-fe15cc5b-b3a4-47c6-9cfe-54200198ef39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Request method failure captured: Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 HTTP/1.1 Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqy5VUB-5vypeDrL9KyCtyy2DyyS5WzgA3UmCKlzAVIbXiUyGwtNVKH4YdoT43FxVSPzB7q3qaWOdTbrhgpdvz9RHCjhxPCeLGhp5RRsc3mvVYG2xmERbClJhrObqW-PqS5mvLReqxJb9XnQ-nSdy0f8YpzQvsj6A3VB2qOFnuuWu98 Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: 606c24bee18a4454ab672cfb6a395286 Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1045984733 Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:39:20.123688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:39:20.125772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/606c24bee18a4454ab672cfb6a395286"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/606c24bee18a4454ab672cfb6a395286"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/606c24bee18a4454ab672cfb6a395286"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_606c24bee18a4454ab672cfb6a395286"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:39:20.125772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1045984733 Aug 31 00:39:20.125772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: 606c24bee18a4454ab672cfb6a395286 Aug 31 00:39:20.125772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1045984733 Aug 31 00:39:20.125772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-AttachVolumeShelveTestJSON-1045984733-project Aug 31 00:39:20.125772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:39:20.125772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:39:20.125772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 2a927401086b4a649919a6071b4a0fd9 Aug 31 00:39:20.125772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1045984733-project Aug 31 00:39:20.125772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:39:20.125772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance dfc3d686-f358-4b8f-b983-984fd54e31e1 could not be found. Aug 31 00:39:20.125772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': 'dfc3d686-f358-4b8f-b983-984fd54e31e1'} Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc3d686-f358-4b8f-b983-984fd54e31e1 could not be found. Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:39:20.126842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:39:20.129058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:39:20.129058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:39:20.129058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:39:20.129058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:39:20.129058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:39:20.129058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:39:20.129058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:39:20.129058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc3d686-f358-4b8f-b983-984fd54e31e1 could not be found. Aug 31 00:39:20.129058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:39:20.129058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:39:20.129058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:39:20.129058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:39:20.129058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:39:20.129058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:39:20.129058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:39:20.129058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:39:20.129058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc3d686-f358-4b8f-b983-984fd54e31e1 could not be found. Aug 31 00:39:20.129058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:39:20.131115 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-fe15cc5b-b3a4-47c6-9cfe-54200198ef39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Returning 404 to user: Instance dfc3d686-f358-4b8f-b983-984fd54e31e1 could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:39:20.131115 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-fe15cc5b-b3a4-47c6-9cfe-54200198ef39 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 404 len: 111 microversion: 2.20 time: 0.046664 Aug 31 00:39:20.131115 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 274/543] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:20 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:39:20.135456 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f52c244c-83bb-482a-95d7-c858e299fb00 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '.version_select at 0x7f551ebdd550>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:20.226997 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f52c244c-83bb-482a-95d7-c858e299fb00 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1024814370" status: 204 len: 0 microversion: 2.20 time: 0.095337 Aug 31 00:39:20.227999 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 270/544] 10.222.0.65 () {60 vars in 1262 bytes} [Wed Aug 31 00:39:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1024814370 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 00:39:21.117562 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-5507e261-c9f6-4356-80c1-72110520f0bc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Action: 'create', calling method: .version_select at 0x7f551eb91c10>, body: {"keypair": {"name": "tempest-keypair-1473017074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDmiGzvnKnUIIJtgjdM65cLcVFEGYuoxyQWDY3JDfH4n7IY9fobPWX/zmOKWYC6jxUDPn78Mtz+/gp5QGvvUU/pj6Nq5WzcpNDklDKf9w1r+gotpwZMkO6hZyE4ApmxXA=="}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:21.134426 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-5507e261-c9f6-4356-80c1-72110520f0bc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Getting quotas for project 606c24bee18a4454ab672cfb6a395286. Resources: {'key_pairs'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:39:21.138300 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-5507e261-c9f6-4356-80c1-72110520f0bc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Getting quotas for user 2a927401086b4a649919a6071b4a0fd9 and project 606c24bee18a4454ab672cfb6a395286. Resources: {'key_pairs'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:39:21.222354 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-5507e261-c9f6-4356-80c1-72110520f0bc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.108801 Aug 31 00:39:21.222877 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 275/545] 10.222.0.65 () {62 vars in 1200 bytes} [Wed Aug 31 00:39:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 00:39:23.474587 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-97c8938c-b593-4697-a8ee-c54346532580 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2055926332", "imageRef": "12947ed8-8ca9-442d-9224-509e79a198e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd1dfc05-b842-4c55-a9f4-0aefefbafd0b"}], "security_groups": [{"name": "tempest-securitygroup--1295923252"}], "key_name": "tempest-keypair-1473017074", "user_data": "}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:23.586466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.network.neutron [None req-97c8938c-b593-4697-a8ee-c54346532580 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] validate_networks() for [('dd1dfc05-b842-4c55-a9f4-0aefefbafd0b', None, None, None, None, None)] {{(pid=128048) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:39:23.969621 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-97c8938c-b593-4697-a8ee-c54346532580 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Flavor limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:39:23.970139 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-97c8938c-b593-4697-a8ee-c54346532580 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Image limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:39:23.970734 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-97c8938c-b593-4697-a8ee-c54346532580 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Flavor pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:39:23.971241 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-97c8938c-b593-4697-a8ee-c54346532580 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Image pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:39:23.971746 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-97c8938c-b593-4697-a8ee-c54346532580 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:39:23.982086 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-97c8938c-b593-4697-a8ee-c54346532580 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:23.982558 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-97c8938c-b593-4697-a8ee-c54346532580 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:23.982983 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-97c8938c-b593-4697-a8ee-c54346532580 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:23.983704 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-97c8938c-b593-4697-a8ee-c54346532580 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:23.984167 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-97c8938c-b593-4697-a8ee-c54346532580 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:23.984588 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-97c8938c-b593-4697-a8ee-c54346532580 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:24.002766 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-97c8938c-b593-4697-a8ee-c54346532580 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Getting quotas for project 606c24bee18a4454ab672cfb6a395286. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:39:24.010535 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-97c8938c-b593-4697-a8ee-c54346532580 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Getting quotas for user 2a927401086b4a649919a6071b4a0fd9 and project 606c24bee18a4454ab672cfb6a395286. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:39:24.021805 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-97c8938c-b593-4697-a8ee-c54346532580 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Going to run 1 instances... {{(pid=128048) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:39:24.024463 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-97c8938c-b593-4697-a8ee-c54346532580 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12947ed8-8ca9-442d-9224-509e79a198e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128048) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:39:24.183011 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-97c8938c-b593-4697-a8ee-c54346532580 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.713386 Aug 31 00:39:24.183663 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 271/546] 10.222.0.65 () {62 vars in 1188 bytes} [Wed Aug 31 00:39:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 00:39:24.197022 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-1c5224e4-7296-42b8-8b45-a86549d653f8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:24.197645 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-1c5224e4-7296-42b8-8b45-a86549d653f8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:24.266549 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-1c5224e4-7296-42b8-8b45-a86549d653f8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:24.275212 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-1c5224e4-7296-42b8-8b45-a86549d653f8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:24.279980 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-1c5224e4-7296-42b8-8b45-a86549d653f8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:24.281175 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-1c5224e4-7296-42b8-8b45-a86549d653f8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1282 microversion: 2.20 time: 0.089890 Aug 31 00:39:24.282217 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 276/547] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:24 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1282 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:39:25.304228 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-e9a214c2-ded7-4aae-b6f1-9b1c0fa546ba tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:25.304909 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-e9a214c2-ded7-4aae-b6f1-9b1c0fa546ba tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:25.312223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e9a214c2-ded7-4aae-b6f1-9b1c0fa546ba tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:25.312768 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e9a214c2-ded7-4aae-b6f1-9b1c0fa546ba tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:25.313210 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e9a214c2-ded7-4aae-b6f1-9b1c0fa546ba tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:25.313905 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e9a214c2-ded7-4aae-b6f1-9b1c0fa546ba tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:25.314357 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e9a214c2-ded7-4aae-b6f1-9b1c0fa546ba tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:25.314809 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e9a214c2-ded7-4aae-b6f1-9b1c0fa546ba tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:25.377370 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-e9a214c2-ded7-4aae-b6f1-9b1c0fa546ba tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:25.386328 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-e9a214c2-ded7-4aae-b6f1-9b1c0fa546ba tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:25.387794 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-e9a214c2-ded7-4aae-b6f1-9b1c0fa546ba tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:25.389518 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-e9a214c2-ded7-4aae-b6f1-9b1c0fa546ba tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1286 microversion: 2.20 time: 0.089658 Aug 31 00:39:25.389845 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 272/548] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:25 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:39:26.411997 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-106e5cc2-2649-4814-a37f-9e1bd06b7a6e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:26.412692 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-106e5cc2-2649-4814-a37f-9e1bd06b7a6e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:26.419582 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-106e5cc2-2649-4814-a37f-9e1bd06b7a6e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:26.420066 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-106e5cc2-2649-4814-a37f-9e1bd06b7a6e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:26.420542 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-106e5cc2-2649-4814-a37f-9e1bd06b7a6e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:26.421240 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-106e5cc2-2649-4814-a37f-9e1bd06b7a6e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:26.421687 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-106e5cc2-2649-4814-a37f-9e1bd06b7a6e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:26.422112 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-106e5cc2-2649-4814-a37f-9e1bd06b7a6e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:26.498288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-106e5cc2-2649-4814-a37f-9e1bd06b7a6e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:26.501872 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-106e5cc2-2649-4814-a37f-9e1bd06b7a6e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:26.503309 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-106e5cc2-2649-4814-a37f-9e1bd06b7a6e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:26.504455 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-106e5cc2-2649-4814-a37f-9e1bd06b7a6e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1334 microversion: 2.20 time: 0.096453 Aug 31 00:39:26.505032 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 277/549] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:26 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1334 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:39:26.522828 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a8ef5638-2641-4e0b-9b19-f75c01660bd5 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:26.523361 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-a8ef5638-2641-4e0b-9b19-f75c01660bd5 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:26.529719 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a8ef5638-2641-4e0b-9b19-f75c01660bd5 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:26.536159 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a8ef5638-2641-4e0b-9b19-f75c01660bd5 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:26.536159 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a8ef5638-2641-4e0b-9b19-f75c01660bd5 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:26.536159 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a8ef5638-2641-4e0b-9b19-f75c01660bd5 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:26.536159 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a8ef5638-2641-4e0b-9b19-f75c01660bd5 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:26.536616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a8ef5638-2641-4e0b-9b19-f75c01660bd5 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:26.617234 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-a8ef5638-2641-4e0b-9b19-f75c01660bd5 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lazy-loading 'services' on Instance uuid 07dc2669-6605-431c-93a5-884348c09ebf {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:39:26.848499 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a8ef5638-2641-4e0b-9b19-f75c01660bd5 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "DELETE /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf/os-volume_attachments/4543f79f-d195-43ac-abf5-c4d12b800e6e" status: 202 len: 0 microversion: 2.1 time: 0.330277 Aug 31 00:39:26.849359 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 273/550] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 00:39:26 2022] DELETE /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf/os-volume_attachments/4543f79f-d195-43ac-abf5-c4d12b800e6e => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:39:27.529963 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-96129797-ab4e-4a27-bea8-81e41e8aca45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:27.530567 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-96129797-ab4e-4a27-bea8-81e41e8aca45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:27.537025 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-96129797-ab4e-4a27-bea8-81e41e8aca45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:27.537583 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-96129797-ab4e-4a27-bea8-81e41e8aca45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:27.538020 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-96129797-ab4e-4a27-bea8-81e41e8aca45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:27.538721 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-96129797-ab4e-4a27-bea8-81e41e8aca45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:27.539263 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-96129797-ab4e-4a27-bea8-81e41e8aca45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:27.539689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-96129797-ab4e-4a27-bea8-81e41e8aca45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:27.621033 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-96129797-ab4e-4a27-bea8-81e41e8aca45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:27.629075 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-96129797-ab4e-4a27-bea8-81e41e8aca45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:27.630518 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-96129797-ab4e-4a27-bea8-81e41e8aca45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:27.632357 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-96129797-ab4e-4a27-bea8-81e41e8aca45 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1340 microversion: 2.20 time: 0.106307 Aug 31 00:39:27.632915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 278/551] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:27 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1340 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:39:28.656188 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9eb04b5e-0151-4555-b32e-4d08ec7a4f7d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:28.656897 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9eb04b5e-0151-4555-b32e-4d08ec7a4f7d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:28.663755 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9eb04b5e-0151-4555-b32e-4d08ec7a4f7d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:28.664258 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9eb04b5e-0151-4555-b32e-4d08ec7a4f7d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:28.664861 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9eb04b5e-0151-4555-b32e-4d08ec7a4f7d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:28.665452 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9eb04b5e-0151-4555-b32e-4d08ec7a4f7d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:28.665863 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9eb04b5e-0151-4555-b32e-4d08ec7a4f7d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:28.666290 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9eb04b5e-0151-4555-b32e-4d08ec7a4f7d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:28.684995 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-84f830e2-36ce-4d96-a5fb-17c45cdb6d31 req-a832b953-852d-4f68-99e5-3e84dbbc539d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "302d7397-56df-414b-a380-afc6b65fc8fa", "tag": "cfcd650e-10f6-464f-a79f-ed420080aea1"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:28.698782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-84f830e2-36ce-4d96-a5fb-17c45cdb6d31 req-a832b953-852d-4f68-99e5-3e84dbbc539d service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:28.699609 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-84f830e2-36ce-4d96-a5fb-17c45cdb6d31 req-a832b953-852d-4f68-99e5-3e84dbbc539d service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:28.700053 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-84f830e2-36ce-4d96-a5fb-17c45cdb6d31 req-a832b953-852d-4f68-99e5-3e84dbbc539d service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:28.713903 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-84f830e2-36ce-4d96-a5fb-17c45cdb6d31 req-a832b953-852d-4f68-99e5-3e84dbbc539d service nova] Creating event network-changed:cfcd650e-10f6-464f-a79f-ed420080aea1 for instance 302d7397-56df-414b-a380-afc6b65fc8fa on hv-cinder-85221 Aug 31 00:39:28.719277 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-84f830e2-36ce-4d96-a5fb-17c45cdb6d31 req-a832b953-852d-4f68-99e5-3e84dbbc539d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044482 Aug 31 00:39:28.719929 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 279/552] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:28.862249 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-9eb04b5e-0151-4555-b32e-4d08ec7a4f7d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:28.870952 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-9eb04b5e-0151-4555-b32e-4d08ec7a4f7d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:28.872432 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-9eb04b5e-0151-4555-b32e-4d08ec7a4f7d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:28.873569 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9eb04b5e-0151-4555-b32e-4d08ec7a4f7d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1408 microversion: 2.20 time: 0.221717 Aug 31 00:39:28.874130 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 274/553] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:28 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:39:29.051901 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-46db7b7b-0bab-42f7-9249-d6d6cf1e0cad tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:29.062171 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-46db7b7b-0bab-42f7-9249-d6d6cf1e0cad tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:29.062656 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-46db7b7b-0bab-42f7-9249-d6d6cf1e0cad tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:29.063326 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-46db7b7b-0bab-42f7-9249-d6d6cf1e0cad tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:29.066929 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=100 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:29.086561 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-46db7b7b-0bab-42f7-9249-d6d6cf1e0cad tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Going to try to stop instance {{(pid=128049) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 00:39:29.252966 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-46db7b7b-0bab-42f7-9249-d6d6cf1e0cad tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "POST /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf/action" status: 202 len: 0 microversion: 2.1 time: 0.208197 Aug 31 00:39:29.253591 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 280/554] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 00:39:29 2022] POST /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:39:29.262595 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-b5fef705-e323-4bdc-8460-5f4b03fbc713 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:29.263580 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-b5fef705-e323-4bdc-8460-5f4b03fbc713 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:29.267042 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:29.271085 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b5fef705-e323-4bdc-8460-5f4b03fbc713 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:29.272068 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b5fef705-e323-4bdc-8460-5f4b03fbc713 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:29.272951 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b5fef705-e323-4bdc-8460-5f4b03fbc713 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:29.274291 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b5fef705-e323-4bdc-8460-5f4b03fbc713 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:29.274848 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b5fef705-e323-4bdc-8460-5f4b03fbc713 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:29.275383 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b5fef705-e323-4bdc-8460-5f4b03fbc713 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:29.291781 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:29.439948 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b5fef705-e323-4bdc-8460-5f4b03fbc713 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:29.449741 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-b5fef705-e323-4bdc-8460-5f4b03fbc713 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1674 microversion: 2.1 time: 0.191149 Aug 31 00:39:29.450288 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 275/555] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:29 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1674 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:29.900714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b409bff4-c361-4135-8d08-d5ef78eb0b1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:29.901419 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-b409bff4-c361-4135-8d08-d5ef78eb0b1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:29.907820 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b409bff4-c361-4135-8d08-d5ef78eb0b1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:29.908339 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b409bff4-c361-4135-8d08-d5ef78eb0b1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:29.908781 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b409bff4-c361-4135-8d08-d5ef78eb0b1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:29.909507 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b409bff4-c361-4135-8d08-d5ef78eb0b1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:29.909957 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b409bff4-c361-4135-8d08-d5ef78eb0b1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:29.910379 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b409bff4-c361-4135-8d08-d5ef78eb0b1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:30.044299 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-b409bff4-c361-4135-8d08-d5ef78eb0b1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:30.052306 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-b409bff4-c361-4135-8d08-d5ef78eb0b1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:30.054588 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-b409bff4-c361-4135-8d08-d5ef78eb0b1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:30.055684 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-b409bff4-c361-4135-8d08-d5ef78eb0b1f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1408 microversion: 2.20 time: 0.160338 Aug 31 00:39:30.056232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 281/556] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:29 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:39:30.472646 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-6345a1d4-acdd-4bbd-8cf4-414483c0bd8e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:30.473255 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-6345a1d4-acdd-4bbd-8cf4-414483c0bd8e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:30.480551 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6345a1d4-acdd-4bbd-8cf4-414483c0bd8e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:30.481083 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6345a1d4-acdd-4bbd-8cf4-414483c0bd8e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:30.481516 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6345a1d4-acdd-4bbd-8cf4-414483c0bd8e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:30.482213 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6345a1d4-acdd-4bbd-8cf4-414483c0bd8e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:30.482668 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6345a1d4-acdd-4bbd-8cf4-414483c0bd8e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:30.483086 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6345a1d4-acdd-4bbd-8cf4-414483c0bd8e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:30.613617 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-6345a1d4-acdd-4bbd-8cf4-414483c0bd8e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:30.621496 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-6345a1d4-acdd-4bbd-8cf4-414483c0bd8e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1674 microversion: 2.1 time: 0.153396 Aug 31 00:39:30.622060 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 276/557] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:30 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:31.077336 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-5dcba52e-d5d4-458b-b5c7-f45b8d53f343 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:31.077930 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-5dcba52e-d5d4-458b-b5c7-f45b8d53f343 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:31.084794 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5dcba52e-d5d4-458b-b5c7-f45b8d53f343 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:31.085266 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5dcba52e-d5d4-458b-b5c7-f45b8d53f343 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:31.085694 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5dcba52e-d5d4-458b-b5c7-f45b8d53f343 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:31.086373 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5dcba52e-d5d4-458b-b5c7-f45b8d53f343 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:31.086815 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5dcba52e-d5d4-458b-b5c7-f45b8d53f343 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:31.087230 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5dcba52e-d5d4-458b-b5c7-f45b8d53f343 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:31.218406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-5dcba52e-d5d4-458b-b5c7-f45b8d53f343 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:31.226615 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-5dcba52e-d5d4-458b-b5c7-f45b8d53f343 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:31.228043 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-5dcba52e-d5d4-458b-b5c7-f45b8d53f343 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:31.229162 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-5dcba52e-d5d4-458b-b5c7-f45b8d53f343 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1408 microversion: 2.20 time: 0.155732 Aug 31 00:39:31.229711 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 282/558] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:31 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:39:31.642797 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7a61f057-f864-46c5-86e9-55950c97452e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:31.643404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7a61f057-f864-46c5-86e9-55950c97452e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:31.650304 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a61f057-f864-46c5-86e9-55950c97452e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:31.650789 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a61f057-f864-46c5-86e9-55950c97452e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:31.651224 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a61f057-f864-46c5-86e9-55950c97452e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:31.652022 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a61f057-f864-46c5-86e9-55950c97452e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:31.652438 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a61f057-f864-46c5-86e9-55950c97452e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:31.652862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a61f057-f864-46c5-86e9-55950c97452e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:31.792726 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-7a61f057-f864-46c5-86e9-55950c97452e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:31.800526 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-7a61f057-f864-46c5-86e9-55950c97452e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1674 microversion: 2.1 time: 0.161566 Aug 31 00:39:31.801105 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 277/559] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:31 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:32.252148 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-306ff376-24d5-40c6-b97a-6d33e826687b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:32.252765 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-306ff376-24d5-40c6-b97a-6d33e826687b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:32.259475 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-306ff376-24d5-40c6-b97a-6d33e826687b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:32.259965 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-306ff376-24d5-40c6-b97a-6d33e826687b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:32.260448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-306ff376-24d5-40c6-b97a-6d33e826687b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:32.261335 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-306ff376-24d5-40c6-b97a-6d33e826687b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:32.261795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-306ff376-24d5-40c6-b97a-6d33e826687b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:32.262225 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-306ff376-24d5-40c6-b97a-6d33e826687b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:32.418703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-306ff376-24d5-40c6-b97a-6d33e826687b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:32.428685 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-306ff376-24d5-40c6-b97a-6d33e826687b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:32.430333 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-306ff376-24d5-40c6-b97a-6d33e826687b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:32.431470 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-306ff376-24d5-40c6-b97a-6d33e826687b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1408 microversion: 2.20 time: 0.183230 Aug 31 00:39:32.432039 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 283/560] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:32 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:39:32.823369 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-639b7129-aafa-4b26-8ad7-539d5073ff1c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:32.823957 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-639b7129-aafa-4b26-8ad7-539d5073ff1c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:32.829838 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-639b7129-aafa-4b26-8ad7-539d5073ff1c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:32.830308 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-639b7129-aafa-4b26-8ad7-539d5073ff1c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:32.830733 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-639b7129-aafa-4b26-8ad7-539d5073ff1c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:32.831409 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-639b7129-aafa-4b26-8ad7-539d5073ff1c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:32.831853 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-639b7129-aafa-4b26-8ad7-539d5073ff1c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:32.832294 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-639b7129-aafa-4b26-8ad7-539d5073ff1c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:32.964200 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-639b7129-aafa-4b26-8ad7-539d5073ff1c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:32.972019 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-639b7129-aafa-4b26-8ad7-539d5073ff1c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1674 microversion: 2.1 time: 0.152537 Aug 31 00:39:32.972625 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 278/561] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:32 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:33.454724 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-7845492a-0136-47ee-ab06-e7e87950742b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:33.455323 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-7845492a-0136-47ee-ab06-e7e87950742b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:33.461834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7845492a-0136-47ee-ab06-e7e87950742b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:33.462311 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7845492a-0136-47ee-ab06-e7e87950742b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:33.462738 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7845492a-0136-47ee-ab06-e7e87950742b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:33.463423 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7845492a-0136-47ee-ab06-e7e87950742b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:33.463869 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7845492a-0136-47ee-ab06-e7e87950742b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:33.464345 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7845492a-0136-47ee-ab06-e7e87950742b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:33.596400 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7845492a-0136-47ee-ab06-e7e87950742b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:33.605942 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7845492a-0136-47ee-ab06-e7e87950742b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:33.607426 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7845492a-0136-47ee-ab06-e7e87950742b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:33.608588 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-7845492a-0136-47ee-ab06-e7e87950742b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1408 microversion: 2.20 time: 0.157851 Aug 31 00:39:33.609150 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 284/562] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:33 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:39:33.993144 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-066767cd-5c0d-453c-af60-d09210f8ebce tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:33.993749 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-066767cd-5c0d-453c-af60-d09210f8ebce tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:33.995646 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:34.000379 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-066767cd-5c0d-453c-af60-d09210f8ebce tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:34.000862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-066767cd-5c0d-453c-af60-d09210f8ebce tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:34.001291 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-066767cd-5c0d-453c-af60-d09210f8ebce tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:34.002009 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-066767cd-5c0d-453c-af60-d09210f8ebce tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:34.002459 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-066767cd-5c0d-453c-af60-d09210f8ebce tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:34.002938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-066767cd-5c0d-453c-af60-d09210f8ebce tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:34.018530 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=6 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:34.144490 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-066767cd-5c0d-453c-af60-d09210f8ebce tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:34.153752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-066767cd-5c0d-453c-af60-d09210f8ebce tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1674 microversion: 2.1 time: 0.164508 Aug 31 00:39:34.154340 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 279/563] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:33 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:34.631442 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-919baa7f-3193-4a5b-8982-49ba552992e2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:34.631968 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-919baa7f-3193-4a5b-8982-49ba552992e2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:34.634005 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=6 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:34.639381 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-919baa7f-3193-4a5b-8982-49ba552992e2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:34.639863 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-919baa7f-3193-4a5b-8982-49ba552992e2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:34.640294 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-919baa7f-3193-4a5b-8982-49ba552992e2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:34.641008 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-919baa7f-3193-4a5b-8982-49ba552992e2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:34.641455 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-919baa7f-3193-4a5b-8982-49ba552992e2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:34.641875 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-919baa7f-3193-4a5b-8982-49ba552992e2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:34.780138 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-919baa7f-3193-4a5b-8982-49ba552992e2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:34.788557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-919baa7f-3193-4a5b-8982-49ba552992e2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:34.790023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-919baa7f-3193-4a5b-8982-49ba552992e2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:34.791150 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-919baa7f-3193-4a5b-8982-49ba552992e2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1408 microversion: 2.20 time: 0.164407 Aug 31 00:39:34.791703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 285/564] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:34 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:39:35.175359 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-04b448c7-d864-46fd-920b-eb71e9b864fa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:35.176002 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-04b448c7-d864-46fd-920b-eb71e9b864fa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:35.182671 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04b448c7-d864-46fd-920b-eb71e9b864fa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:35.183148 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04b448c7-d864-46fd-920b-eb71e9b864fa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:35.183577 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04b448c7-d864-46fd-920b-eb71e9b864fa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:35.184280 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04b448c7-d864-46fd-920b-eb71e9b864fa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:35.184747 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04b448c7-d864-46fd-920b-eb71e9b864fa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:35.185160 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04b448c7-d864-46fd-920b-eb71e9b864fa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:35.326080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-04b448c7-d864-46fd-920b-eb71e9b864fa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:35.335238 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-04b448c7-d864-46fd-920b-eb71e9b864fa tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1674 microversion: 2.1 time: 0.163042 Aug 31 00:39:35.335238 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 280/565] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:35 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:35.815231 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4f2adaec-d007-4b92-a98a-763873efcd89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:35.816065 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4f2adaec-d007-4b92-a98a-763873efcd89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:35.823202 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4f2adaec-d007-4b92-a98a-763873efcd89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:35.823665 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4f2adaec-d007-4b92-a98a-763873efcd89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:35.824107 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4f2adaec-d007-4b92-a98a-763873efcd89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:35.824855 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4f2adaec-d007-4b92-a98a-763873efcd89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:35.825301 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4f2adaec-d007-4b92-a98a-763873efcd89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:35.825914 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4f2adaec-d007-4b92-a98a-763873efcd89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:35.879589 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-3e1947ff-d63f-409a-908c-01eb5db14f29 req-e39b79b3-93fc-40f8-98f6-97337de68d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "302d7397-56df-414b-a380-afc6b65fc8fa", "name": "network-vif-plugged", "status": "completed", "tag": "cfcd650e-10f6-464f-a79f-ed420080aea1"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:35.886087 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-3e1947ff-d63f-409a-908c-01eb5db14f29 req-e39b79b3-93fc-40f8-98f6-97337de68d0e service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:35.886702 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-3e1947ff-d63f-409a-908c-01eb5db14f29 req-e39b79b3-93fc-40f8-98f6-97337de68d0e service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:35.887143 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-3e1947ff-d63f-409a-908c-01eb5db14f29 req-e39b79b3-93fc-40f8-98f6-97337de68d0e service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:35.900750 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-3e1947ff-d63f-409a-908c-01eb5db14f29 req-e39b79b3-93fc-40f8-98f6-97337de68d0e service nova] Creating event network-vif-plugged:cfcd650e-10f6-464f-a79f-ed420080aea1 for instance 302d7397-56df-414b-a380-afc6b65fc8fa on hv-cinder-85221 Aug 31 00:39:35.906092 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-3e1947ff-d63f-409a-908c-01eb5db14f29 req-e39b79b3-93fc-40f8-98f6-97337de68d0e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034508 Aug 31 00:39:35.907371 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 281/566] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:35.978386 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4f2adaec-d007-4b92-a98a-763873efcd89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:35.987384 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4f2adaec-d007-4b92-a98a-763873efcd89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:35.990291 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4f2adaec-d007-4b92-a98a-763873efcd89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:35.992346 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4f2adaec-d007-4b92-a98a-763873efcd89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1408 microversion: 2.20 time: 0.180787 Aug 31 00:39:35.992927 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 286/567] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:35 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:39:36.357101 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-97b87dbe-788d-404c-a2ba-7fbdae9979ff tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:36.357907 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-97b87dbe-788d-404c-a2ba-7fbdae9979ff tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:36.364518 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-97b87dbe-788d-404c-a2ba-7fbdae9979ff tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:36.365602 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-97b87dbe-788d-404c-a2ba-7fbdae9979ff tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:36.366343 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-97b87dbe-788d-404c-a2ba-7fbdae9979ff tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:36.367204 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-97b87dbe-788d-404c-a2ba-7fbdae9979ff tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:36.367666 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-97b87dbe-788d-404c-a2ba-7fbdae9979ff tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:36.368404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-97b87dbe-788d-404c-a2ba-7fbdae9979ff tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:36.518101 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-97b87dbe-788d-404c-a2ba-7fbdae9979ff tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:36.526658 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-97b87dbe-788d-404c-a2ba-7fbdae9979ff tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1674 microversion: 2.1 time: 0.173729 Aug 31 00:39:36.527233 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 282/568] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:36 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:37.017926 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-dc1c7a89-fc65-47d9-b859-bd0f5cf016f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:37.018532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-dc1c7a89-fc65-47d9-b859-bd0f5cf016f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:37.025737 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dc1c7a89-fc65-47d9-b859-bd0f5cf016f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:37.026215 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dc1c7a89-fc65-47d9-b859-bd0f5cf016f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:37.026667 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dc1c7a89-fc65-47d9-b859-bd0f5cf016f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:37.027356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dc1c7a89-fc65-47d9-b859-bd0f5cf016f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:37.027804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dc1c7a89-fc65-47d9-b859-bd0f5cf016f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:37.028283 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dc1c7a89-fc65-47d9-b859-bd0f5cf016f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:37.177657 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-dc1c7a89-fc65-47d9-b859-bd0f5cf016f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:37.187308 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-dc1c7a89-fc65-47d9-b859-bd0f5cf016f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:37.188770 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-dc1c7a89-fc65-47d9-b859-bd0f5cf016f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:37.190701 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-dc1c7a89-fc65-47d9-b859-bd0f5cf016f7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1408 microversion: 2.20 time: 0.176722 Aug 31 00:39:37.191454 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 287/569] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:37 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:39:37.578213 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-416b3b12-064a-4d62-b490-ff0d2344d166 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:37.578213 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-416b3b12-064a-4d62-b490-ff0d2344d166 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:37.578213 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-416b3b12-064a-4d62-b490-ff0d2344d166 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:37.578213 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-416b3b12-064a-4d62-b490-ff0d2344d166 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:37.579108 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-416b3b12-064a-4d62-b490-ff0d2344d166 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:37.579108 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-416b3b12-064a-4d62-b490-ff0d2344d166 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:37.579108 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-416b3b12-064a-4d62-b490-ff0d2344d166 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:37.579108 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-416b3b12-064a-4d62-b490-ff0d2344d166 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:37.713993 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-416b3b12-064a-4d62-b490-ff0d2344d166 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:37.722108 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-416b3b12-064a-4d62-b490-ff0d2344d166 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1674 microversion: 2.1 time: 0.176392 Aug 31 00:39:37.722688 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 283/570] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:37 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:38.214342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-82096c72-29d7-4297-b083-939bf9152301 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:38.214986 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-82096c72-29d7-4297-b083-939bf9152301 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:38.221758 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-82096c72-29d7-4297-b083-939bf9152301 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:38.222234 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-82096c72-29d7-4297-b083-939bf9152301 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:38.222661 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-82096c72-29d7-4297-b083-939bf9152301 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:38.223348 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-82096c72-29d7-4297-b083-939bf9152301 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:38.223792 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-82096c72-29d7-4297-b083-939bf9152301 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:38.224208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-82096c72-29d7-4297-b083-939bf9152301 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:38.359182 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-82096c72-29d7-4297-b083-939bf9152301 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:38.368306 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-82096c72-29d7-4297-b083-939bf9152301 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:38.372515 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-82096c72-29d7-4297-b083-939bf9152301 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:38.372515 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-82096c72-29d7-4297-b083-939bf9152301 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1408 microversion: 2.20 time: 0.160504 Aug 31 00:39:38.372515 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 288/571] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:38 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:39:38.745175 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-606a0f9d-03bc-492e-856a-ccd1b121d7e7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:38.745782 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-606a0f9d-03bc-492e-856a-ccd1b121d7e7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:38.752166 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-606a0f9d-03bc-492e-856a-ccd1b121d7e7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:38.753764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-606a0f9d-03bc-492e-856a-ccd1b121d7e7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:38.753764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-606a0f9d-03bc-492e-856a-ccd1b121d7e7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:38.754045 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-606a0f9d-03bc-492e-856a-ccd1b121d7e7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:38.754341 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-606a0f9d-03bc-492e-856a-ccd1b121d7e7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:38.754766 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-606a0f9d-03bc-492e-856a-ccd1b121d7e7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:38.890443 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-606a0f9d-03bc-492e-856a-ccd1b121d7e7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:38.898782 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-606a0f9d-03bc-492e-856a-ccd1b121d7e7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1674 microversion: 2.1 time: 0.157552 Aug 31 00:39:38.899611 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 284/572] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:38 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:39.393965 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6acfd7ed-92aa-492c-af79-89ef7f0908ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:39.394520 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6acfd7ed-92aa-492c-af79-89ef7f0908ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:39.401995 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6acfd7ed-92aa-492c-af79-89ef7f0908ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:39.402469 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6acfd7ed-92aa-492c-af79-89ef7f0908ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:39.402894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6acfd7ed-92aa-492c-af79-89ef7f0908ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:39.403577 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6acfd7ed-92aa-492c-af79-89ef7f0908ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:39.404016 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6acfd7ed-92aa-492c-af79-89ef7f0908ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:39.404454 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6acfd7ed-92aa-492c-af79-89ef7f0908ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:39.539343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6acfd7ed-92aa-492c-af79-89ef7f0908ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:39.547690 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6acfd7ed-92aa-492c-af79-89ef7f0908ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:39.549165 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6acfd7ed-92aa-492c-af79-89ef7f0908ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:39.550306 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6acfd7ed-92aa-492c-af79-89ef7f0908ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1601 microversion: 2.20 time: 0.160326 Aug 31 00:39:39.550908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 289/573] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:39:39 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:39:39.573614 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d99e0de8-863d-40aa-8c4b-64a945b2d8d2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:39.574075 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d99e0de8-863d-40aa-8c4b-64a945b2d8d2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:39.579955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d99e0de8-863d-40aa-8c4b-64a945b2d8d2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:39.580457 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d99e0de8-863d-40aa-8c4b-64a945b2d8d2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:39.580913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d99e0de8-863d-40aa-8c4b-64a945b2d8d2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:39.581589 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d99e0de8-863d-40aa-8c4b-64a945b2d8d2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:39.582030 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d99e0de8-863d-40aa-8c4b-64a945b2d8d2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:39.582443 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d99e0de8-863d-40aa-8c4b-64a945b2d8d2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:39.663545 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d99e0de8-863d-40aa-8c4b-64a945b2d8d2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.094745 Aug 31 00:39:39.664138 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 285/574] 10.222.0.65 () {60 vars in 1316 bytes} [Wed Aug 31 00:39:39 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:39:39.920658 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-566c7c4d-563a-4c76-bc23-d758db01e492 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:39.921395 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-566c7c4d-563a-4c76-bc23-d758db01e492 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:39.930204 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-566c7c4d-563a-4c76-bc23-d758db01e492 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:39.930444 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-566c7c4d-563a-4c76-bc23-d758db01e492 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:39.930746 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-566c7c4d-563a-4c76-bc23-d758db01e492 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:39.931596 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-566c7c4d-563a-4c76-bc23-d758db01e492 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:39.932214 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-566c7c4d-563a-4c76-bc23-d758db01e492 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:39.932922 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-566c7c4d-563a-4c76-bc23-d758db01e492 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:40.079990 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-566c7c4d-563a-4c76-bc23-d758db01e492 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:40.088554 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-566c7c4d-563a-4c76-bc23-d758db01e492 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1651 microversion: 2.1 time: 0.171525 Aug 31 00:39:40.089188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 290/575] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:39 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1651 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:40.112354 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-210ca723-d826-47d1-b77f-c8cb354b925d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:40.119324 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-210ca723-d826-47d1-b77f-c8cb354b925d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:40.119810 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-210ca723-d826-47d1-b77f-c8cb354b925d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:40.120236 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-210ca723-d826-47d1-b77f-c8cb354b925d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:40.143861 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-210ca723-d826-47d1-b77f-c8cb354b925d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Going to try to start instance {{(pid=128048) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 00:39:40.349411 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-210ca723-d826-47d1-b77f-c8cb354b925d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "POST /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf/action" status: 202 len: 0 microversion: 2.1 time: 0.240611 Aug 31 00:39:40.350865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 286/576] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 00:39:40 2022] POST /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:39:40.359031 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-55ad4dfa-e9de-4f6f-8f43-73e67f2a0ef9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:40.365232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-55ad4dfa-e9de-4f6f-8f43-73e67f2a0ef9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:40.372120 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-55ad4dfa-e9de-4f6f-8f43-73e67f2a0ef9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:40.372585 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-55ad4dfa-e9de-4f6f-8f43-73e67f2a0ef9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:40.373243 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-55ad4dfa-e9de-4f6f-8f43-73e67f2a0ef9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:40.373756 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-55ad4dfa-e9de-4f6f-8f43-73e67f2a0ef9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:40.374567 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-55ad4dfa-e9de-4f6f-8f43-73e67f2a0ef9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:40.374698 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-55ad4dfa-e9de-4f6f-8f43-73e67f2a0ef9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:40.516140 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-55ad4dfa-e9de-4f6f-8f43-73e67f2a0ef9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:40.524844 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-55ad4dfa-e9de-4f6f-8f43-73e67f2a0ef9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1660 microversion: 2.1 time: 0.169669 Aug 31 00:39:40.525403 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 291/577] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:40 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1660 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:39:41.166547 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-746dcc4d-4809-43a6-aee0-de58dc8ea2d8 req-88fe560e-38bb-4b07-977e-a010228a0101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "302d7397-56df-414b-a380-afc6b65fc8fa", "tag": "cfcd650e-10f6-464f-a79f-ed420080aea1"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:41.176103 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-746dcc4d-4809-43a6-aee0-de58dc8ea2d8 req-88fe560e-38bb-4b07-977e-a010228a0101 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:41.176661 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-746dcc4d-4809-43a6-aee0-de58dc8ea2d8 req-88fe560e-38bb-4b07-977e-a010228a0101 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:41.177022 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-746dcc4d-4809-43a6-aee0-de58dc8ea2d8 req-88fe560e-38bb-4b07-977e-a010228a0101 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:41.191917 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-746dcc4d-4809-43a6-aee0-de58dc8ea2d8 req-88fe560e-38bb-4b07-977e-a010228a0101 service nova] Creating event network-changed:cfcd650e-10f6-464f-a79f-ed420080aea1 for instance 302d7397-56df-414b-a380-afc6b65fc8fa on hv-cinder-85221 Aug 31 00:39:41.198123 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-746dcc4d-4809-43a6-aee0-de58dc8ea2d8 req-88fe560e-38bb-4b07-977e-a010228a0101 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037589 Aug 31 00:39:41.198724 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 287/578] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:41.547046 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-581f5d22-540a-44c5-8767-57df5d626588 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:41.547651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-581f5d22-540a-44c5-8767-57df5d626588 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:41.555021 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-581f5d22-540a-44c5-8767-57df5d626588 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:41.555516 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-581f5d22-540a-44c5-8767-57df5d626588 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:41.555953 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-581f5d22-540a-44c5-8767-57df5d626588 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:41.556707 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-581f5d22-540a-44c5-8767-57df5d626588 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:41.557157 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-581f5d22-540a-44c5-8767-57df5d626588 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:41.557575 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-581f5d22-540a-44c5-8767-57df5d626588 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:41.703423 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-581f5d22-540a-44c5-8767-57df5d626588 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:41.711741 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-581f5d22-540a-44c5-8767-57df5d626588 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1660 microversion: 2.1 time: 0.168449 Aug 31 00:39:41.713342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 292/579] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:41 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1660 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:42.733796 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-fb898fde-a20d-499e-9dc1-18276e7f4530 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:42.734477 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-fb898fde-a20d-499e-9dc1-18276e7f4530 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:42.740774 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fb898fde-a20d-499e-9dc1-18276e7f4530 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:42.741185 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fb898fde-a20d-499e-9dc1-18276e7f4530 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:42.741611 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fb898fde-a20d-499e-9dc1-18276e7f4530 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:42.742354 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fb898fde-a20d-499e-9dc1-18276e7f4530 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:42.742747 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fb898fde-a20d-499e-9dc1-18276e7f4530 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:42.743505 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fb898fde-a20d-499e-9dc1-18276e7f4530 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:42.894206 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fb898fde-a20d-499e-9dc1-18276e7f4530 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:42.903440 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-fb898fde-a20d-499e-9dc1-18276e7f4530 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1660 microversion: 2.1 time: 0.173776 Aug 31 00:39:42.904012 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 288/580] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:42 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1660 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:43.925567 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-1eca0d34-cdf5-4c4b-8b43-6ac9fd7d2618 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:43.926396 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-1eca0d34-cdf5-4c4b-8b43-6ac9fd7d2618 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:43.934077 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1eca0d34-cdf5-4c4b-8b43-6ac9fd7d2618 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:43.934586 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1eca0d34-cdf5-4c4b-8b43-6ac9fd7d2618 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:43.935047 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1eca0d34-cdf5-4c4b-8b43-6ac9fd7d2618 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:43.935739 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1eca0d34-cdf5-4c4b-8b43-6ac9fd7d2618 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:43.936195 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1eca0d34-cdf5-4c4b-8b43-6ac9fd7d2618 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:43.936651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1eca0d34-cdf5-4c4b-8b43-6ac9fd7d2618 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:44.072955 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-1eca0d34-cdf5-4c4b-8b43-6ac9fd7d2618 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:44.080778 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-1eca0d34-cdf5-4c4b-8b43-6ac9fd7d2618 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1664 microversion: 2.1 time: 0.159350 Aug 31 00:39:44.081436 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 293/581] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:43 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:46.541761 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9dcf0143-b543-46e0-9705-0fd0b6308c2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:46.542311 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9dcf0143-b543-46e0-9705-0fd0b6308c2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:46.548373 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9dcf0143-b543-46e0-9705-0fd0b6308c2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:46.548855 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9dcf0143-b543-46e0-9705-0fd0b6308c2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:46.549291 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9dcf0143-b543-46e0-9705-0fd0b6308c2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:46.549972 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9dcf0143-b543-46e0-9705-0fd0b6308c2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:46.550417 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9dcf0143-b543-46e0-9705-0fd0b6308c2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:46.550833 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9dcf0143-b543-46e0-9705-0fd0b6308c2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:46.577852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9dcf0143-b543-46e0-9705-0fd0b6308c2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Going to try to terminate instance {{(pid=128048) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:39:46.878159 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9dcf0143-b543-46e0-9705-0fd0b6308c2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 204 len: 0 microversion: 2.1 time: 0.335964 Aug 31 00:39:46.880224 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 289/582] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:39:46 2022] DELETE /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:39:46.889565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-529bd43c-89b3-4a5f-bab6-49bdad66661d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:46.890430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-529bd43c-89b3-4a5f-bab6-49bdad66661d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:46.897867 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-529bd43c-89b3-4a5f-bab6-49bdad66661d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:46.898421 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-529bd43c-89b3-4a5f-bab6-49bdad66661d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:46.899409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-529bd43c-89b3-4a5f-bab6-49bdad66661d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:46.900214 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-529bd43c-89b3-4a5f-bab6-49bdad66661d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:46.900722 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-529bd43c-89b3-4a5f-bab6-49bdad66661d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:46.905832 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-529bd43c-89b3-4a5f-bab6-49bdad66661d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:47.050115 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-529bd43c-89b3-4a5f-bab6-49bdad66661d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:47.060075 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-529bd43c-89b3-4a5f-bab6-49bdad66661d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1579 microversion: 2.1 time: 0.174763 Aug 31 00:39:47.060688 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 294/583] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:46 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1579 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:48.087673 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f9b344f9-9345-45c1-a572-f41e189783ac tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:48.088384 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-f9b344f9-9345-45c1-a572-f41e189783ac tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:48.094296 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f9b344f9-9345-45c1-a572-f41e189783ac tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:48.094771 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f9b344f9-9345-45c1-a572-f41e189783ac tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:48.095197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f9b344f9-9345-45c1-a572-f41e189783ac tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:48.095871 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f9b344f9-9345-45c1-a572-f41e189783ac tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:48.096345 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f9b344f9-9345-45c1-a572-f41e189783ac tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:48.096808 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f9b344f9-9345-45c1-a572-f41e189783ac tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:48.401812 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f9b344f9-9345-45c1-a572-f41e189783ac tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:48.410617 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f9b344f9-9345-45c1-a572-f41e189783ac tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1579 microversion: 2.1 time: 0.327207 Aug 31 00:39:48.411242 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 290/584] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:48 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1579 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:49.367818 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0b824b41-5a8f-438e-ac28-ffdfb23b76ce tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:49.368392 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-0b824b41-5a8f-438e-ac28-ffdfb23b76ce tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:49.374789 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0b824b41-5a8f-438e-ac28-ffdfb23b76ce tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:49.375279 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0b824b41-5a8f-438e-ac28-ffdfb23b76ce tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:49.375710 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0b824b41-5a8f-438e-ac28-ffdfb23b76ce tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:49.376440 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0b824b41-5a8f-438e-ac28-ffdfb23b76ce tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:49.376897 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0b824b41-5a8f-438e-ac28-ffdfb23b76ce tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:49.377319 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0b824b41-5a8f-438e-ac28-ffdfb23b76ce tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:49.434112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-fae16117-39cb-48aa-b3e0-404e0ff416b4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:49.437290 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-fae16117-39cb-48aa-b3e0-404e0ff416b4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:49.441308 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fae16117-39cb-48aa-b3e0-404e0ff416b4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:49.442112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fae16117-39cb-48aa-b3e0-404e0ff416b4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:49.442613 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fae16117-39cb-48aa-b3e0-404e0ff416b4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:49.443970 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fae16117-39cb-48aa-b3e0-404e0ff416b4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:49.444689 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fae16117-39cb-48aa-b3e0-404e0ff416b4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:49.445125 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fae16117-39cb-48aa-b3e0-404e0ff416b4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:49.449939 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:49.547299 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fae16117-39cb-48aa-b3e0-404e0ff416b4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:49.574819 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-fae16117-39cb-48aa-b3e0-404e0ff416b4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1511 microversion: 2.1 time: 0.144397 Aug 31 00:39:49.575758 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 291/585] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:49 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1511 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:49.611404 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:49.617171 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-0b824b41-5a8f-438e-ac28-ffdfb23b76ce tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lazy-loading 'services' on Instance uuid 95f8fa2f-7f69-4291-903c-1618b2c28146 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:39:49.847633 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-43c32298-e522-4d6b-8fe0-f454836cd4f1 req-a58458e0-5dc6-431d-8af8-7ac2839ff5db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c", "name": "network-vif-deleted", "tag": "a10d4df1-cb0a-416e-86a7-7179c9f9aac0"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:49.859254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-43c32298-e522-4d6b-8fe0-f454836cd4f1 req-a58458e0-5dc6-431d-8af8-7ac2839ff5db service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:49.866907 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-43c32298-e522-4d6b-8fe0-f454836cd4f1 req-a58458e0-5dc6-431d-8af8-7ac2839ff5db service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:49.866907 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-43c32298-e522-4d6b-8fe0-f454836cd4f1 req-a58458e0-5dc6-431d-8af8-7ac2839ff5db service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:49.872814 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-43c32298-e522-4d6b-8fe0-f454836cd4f1 req-a58458e0-5dc6-431d-8af8-7ac2839ff5db service nova] Creating event network-vif-deleted:a10d4df1-cb0a-416e-86a7-7179c9f9aac0 for instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c on hv-cinder-85221 Aug 31 00:39:49.881552 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-43c32298-e522-4d6b-8fe0-f454836cd4f1 req-a58458e0-5dc6-431d-8af8-7ac2839ff5db service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036435 Aug 31 00:39:49.886429 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 292/586] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:39:49.982101 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-0b824b41-5a8f-438e-ac28-ffdfb23b76ce tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "DELETE /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/os-volume_attachments/8609c323-46de-4af1-82be-cb10793250c9" status: 202 len: 0 microversion: 2.1 time: 0.618303 Aug 31 00:39:49.983281 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 295/587] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 00:39:49 2022] DELETE /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/os-volume_attachments/8609c323-46de-4af1-82be-cb10793250c9 => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:39:49.993386 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f5c54909-d422-408d-a1be-97a719f6a345 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:50.000876 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-f5c54909-d422-408d-a1be-97a719f6a345 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:50.012262 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f5c54909-d422-408d-a1be-97a719f6a345 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:50.032218 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f5c54909-d422-408d-a1be-97a719f6a345 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:50.032218 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f5c54909-d422-408d-a1be-97a719f6a345 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:50.032218 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f5c54909-d422-408d-a1be-97a719f6a345 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:50.032218 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f5c54909-d422-408d-a1be-97a719f6a345 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:50.032811 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f5c54909-d422-408d-a1be-97a719f6a345 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:50.051277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f5c54909-d422-408d-a1be-97a719f6a345 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063453 Aug 31 00:39:50.053534 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 293/588] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:49 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:50.606623 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8867f2e9-f17a-425d-9ccd-108b6ae85409 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:50.607360 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8867f2e9-f17a-425d-9ccd-108b6ae85409 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:50.609322 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:50.614516 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8867f2e9-f17a-425d-9ccd-108b6ae85409 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:50.624251 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8867f2e9-f17a-425d-9ccd-108b6ae85409 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:50.624251 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8867f2e9-f17a-425d-9ccd-108b6ae85409 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:50.624251 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8867f2e9-f17a-425d-9ccd-108b6ae85409 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:50.624251 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8867f2e9-f17a-425d-9ccd-108b6ae85409 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:50.624744 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8867f2e9-f17a-425d-9ccd-108b6ae85409 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:50.688750 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8867f2e9-f17a-425d-9ccd-108b6ae85409 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:50.701956 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8867f2e9-f17a-425d-9ccd-108b6ae85409 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1226 microversion: 2.1 time: 0.100048 Aug 31 00:39:50.702544 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 296/589] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:50 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:51.065943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-95a08ace-8c9d-45c6-a3f4-a9fa6faa82e0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:51.068117 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-95a08ace-8c9d-45c6-a3f4-a9fa6faa82e0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:51.074853 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-95a08ace-8c9d-45c6-a3f4-a9fa6faa82e0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:51.075342 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-95a08ace-8c9d-45c6-a3f4-a9fa6faa82e0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:51.075774 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-95a08ace-8c9d-45c6-a3f4-a9fa6faa82e0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:51.076780 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-95a08ace-8c9d-45c6-a3f4-a9fa6faa82e0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:51.077239 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-95a08ace-8c9d-45c6-a3f4-a9fa6faa82e0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:51.078099 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-95a08ace-8c9d-45c6-a3f4-a9fa6faa82e0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:51.111398 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-95a08ace-8c9d-45c6-a3f4-a9fa6faa82e0 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049773 Aug 31 00:39:51.112950 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 294/590] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:51 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:51.723792 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6f813a34-40c8-4bdc-ac54-a06fb1075297 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:51.724625 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6f813a34-40c8-4bdc-ac54-a06fb1075297 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:51.731292 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f813a34-40c8-4bdc-ac54-a06fb1075297 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:51.732518 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f813a34-40c8-4bdc-ac54-a06fb1075297 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:51.732518 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f813a34-40c8-4bdc-ac54-a06fb1075297 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:51.733014 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f813a34-40c8-4bdc-ac54-a06fb1075297 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:51.733463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f813a34-40c8-4bdc-ac54-a06fb1075297 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:51.733880 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f813a34-40c8-4bdc-ac54-a06fb1075297 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:51.769035 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f813a34-40c8-4bdc-ac54-a06fb1075297 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:51.769491 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f813a34-40c8-4bdc-ac54-a06fb1075297 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:51.769920 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6f813a34-40c8-4bdc-ac54-a06fb1075297 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:51.770355 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-6f813a34-40c8-4bdc-ac54-a06fb1075297 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lazy-loading 'fault' on Instance uuid c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:39:51.812856 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6f813a34-40c8-4bdc-ac54-a06fb1075297 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:51.821552 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6f813a34-40c8-4bdc-ac54-a06fb1075297 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 200 len: 1231 microversion: 2.1 time: 0.102501 Aug 31 00:39:51.822114 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 297/591] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:51 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:52.124210 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7d0b1ed0-e40d-4f62-b373-fb64179337d5 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:52.126300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7d0b1ed0-e40d-4f62-b373-fb64179337d5 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:52.133504 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7d0b1ed0-e40d-4f62-b373-fb64179337d5 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:52.133991 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7d0b1ed0-e40d-4f62-b373-fb64179337d5 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:52.134459 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7d0b1ed0-e40d-4f62-b373-fb64179337d5 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:52.135121 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7d0b1ed0-e40d-4f62-b373-fb64179337d5 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:52.135570 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7d0b1ed0-e40d-4f62-b373-fb64179337d5 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:52.135993 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7d0b1ed0-e40d-4f62-b373-fb64179337d5 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:52.166140 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-7d0b1ed0-e40d-4f62-b373-fb64179337d5 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045867 Aug 31 00:39:52.167508 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 295/592] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:39:52 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:39:52.245530 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d3ba9dd6-4971-4b1f-9dd7-de4c1c626751 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:52.246022 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d3ba9dd6-4971-4b1f-9dd7-de4c1c626751 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:52.251990 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d3ba9dd6-4971-4b1f-9dd7-de4c1c626751 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:52.252513 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d3ba9dd6-4971-4b1f-9dd7-de4c1c626751 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:52.252955 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d3ba9dd6-4971-4b1f-9dd7-de4c1c626751 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:52.253642 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d3ba9dd6-4971-4b1f-9dd7-de4c1c626751 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:52.254091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d3ba9dd6-4971-4b1f-9dd7-de4c1c626751 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:52.254528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d3ba9dd6-4971-4b1f-9dd7-de4c1c626751 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:52.280643 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d3ba9dd6-4971-4b1f-9dd7-de4c1c626751 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Going to try to terminate instance {{(pid=128049) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:39:52.666716 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d3ba9dd6-4971-4b1f-9dd7-de4c1c626751 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "DELETE /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 204 len: 0 microversion: 2.1 time: 0.424773 Aug 31 00:39:52.667303 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 298/593] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:39:52 2022] DELETE /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:39:52.675731 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-b92143db-e1bd-47e3-9d0b-d4a49be60056 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:52.677236 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-b92143db-e1bd-47e3-9d0b-d4a49be60056 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:52.683618 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b92143db-e1bd-47e3-9d0b-d4a49be60056 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:52.684099 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b92143db-e1bd-47e3-9d0b-d4a49be60056 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:52.684693 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b92143db-e1bd-47e3-9d0b-d4a49be60056 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:52.685451 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b92143db-e1bd-47e3-9d0b-d4a49be60056 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:52.685901 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b92143db-e1bd-47e3-9d0b-d4a49be60056 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:52.686320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b92143db-e1bd-47e3-9d0b-d4a49be60056 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:52.825028 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b92143db-e1bd-47e3-9d0b-d4a49be60056 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:52.833207 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-b92143db-e1bd-47e3-9d0b-d4a49be60056 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1687 microversion: 2.1 time: 0.161602 Aug 31 00:39:52.833768 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 296/594] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:52 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:52.844233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0e264803-fbb8-4d9f-a857-cedb075e8dbe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:52.844956 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-0e264803-fbb8-4d9f-a857-cedb075e8dbe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:52.852970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0e264803-fbb8-4d9f-a857-cedb075e8dbe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:52.853451 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0e264803-fbb8-4d9f-a857-cedb075e8dbe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:52.853906 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0e264803-fbb8-4d9f-a857-cedb075e8dbe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:52.854581 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0e264803-fbb8-4d9f-a857-cedb075e8dbe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:52.855032 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0e264803-fbb8-4d9f-a857-cedb075e8dbe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:52.855452 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0e264803-fbb8-4d9f-a857-cedb075e8dbe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:52.869809 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-0e264803-fbb8-4d9f-a857-cedb075e8dbe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] HTTP exception thrown: Instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c could not be found. Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0e264803-fbb8-4d9f-a857-cedb075e8dbe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Request method failure captured: Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c HTTP/1.1 Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqz6bcJzptONpYzZ--ZxIFkUzMrDN78zWIuu9D1e8slegZKQFDIUR23b9Wk_yos9bDDSwM5IEKLs0-WFJ5UNXiEFrjXcmVGtPeg__15wQjQd90xqU_iIDATE3bR0sdytfyIwr2Fuu6kys33v7DJjsesMlqVcEzLokOVGJK-DL_Q49Ew Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: ebe5283d88b44f8b824c7bbca56b3473 Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-TestVolumeBootPattern-1930465684 Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:39:52.871471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:39:52.872914 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:39:52.872914 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-TestVolumeBootPattern-1930465684 Aug 31 00:39:52.872914 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: ebe5283d88b44f8b824c7bbca56b3473 Aug 31 00:39:52.872914 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-TestVolumeBootPattern-1930465684 Aug 31 00:39:52.872914 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-TestVolumeBootPattern-1930465684-project Aug 31 00:39:52.872914 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:39:52.872914 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:39:52.872914 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 022c4688d9ce4df9a99ae5fa84e1d871 Aug 31 00:39:52.872914 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-TestVolumeBootPattern-1930465684-project Aug 31 00:39:52.872914 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:39:52.872914 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c could not be found. Aug 31 00:39:52.872914 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': 'c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c'} Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c could not be found. Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:39:52.873672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:39:52.874843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:39:52.874843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:39:52.874843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:39:52.874843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:39:52.874843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:39:52.874843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:39:52.874843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:39:52.874843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c could not be found. Aug 31 00:39:52.874843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:39:52.874843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:39:52.874843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:39:52.874843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:39:52.874843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:39:52.874843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:39:52.874843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:39:52.874843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:39:52.874843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c could not be found. Aug 31 00:39:52.874843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:39:52.875912 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0e264803-fbb8-4d9f-a857-cedb075e8dbe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Returning 404 to user: Instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:39:52.875912 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-0e264803-fbb8-4d9f-a857-cedb075e8dbe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 404 len: 111 microversion: 2.1 time: 0.033278 Aug 31 00:39:52.875912 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 299/595] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:52 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:39:53.029451 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d255d43d-17b9-4456-b626-19bd3dec54b3 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1253709377", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1773331990", "security_groups": [{"name": "tempest-secgroup-smoke-1046497227"}], "block_device_mapping_v2": [{"uuid": "e809d00f-5c75-4627-b573-208034333980", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5c79103f-c4fa-4069-a202-b12e6c4f8e87"}]}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:53.152452 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.network.neutron [None req-d255d43d-17b9-4456-b626-19bd3dec54b3 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] validate_networks() for [('5c79103f-c4fa-4069-a202-b12e6c4f8e87', None, None, None, None, None)] {{(pid=128048) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:39:53.549745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-d255d43d-17b9-4456-b626-19bd3dec54b3 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Flavor limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:39:53.550162 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-d255d43d-17b9-4456-b626-19bd3dec54b3 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Image limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:39:53.550629 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-d255d43d-17b9-4456-b626-19bd3dec54b3 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Flavor pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:39:53.551028 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-d255d43d-17b9-4456-b626-19bd3dec54b3 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Image pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:39:53.551485 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-d255d43d-17b9-4456-b626-19bd3dec54b3 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:39:53.562217 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d255d43d-17b9-4456-b626-19bd3dec54b3 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:53.562699 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d255d43d-17b9-4456-b626-19bd3dec54b3 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:53.565172 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d255d43d-17b9-4456-b626-19bd3dec54b3 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:53.565172 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d255d43d-17b9-4456-b626-19bd3dec54b3 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:53.565172 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d255d43d-17b9-4456-b626-19bd3dec54b3 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:53.565172 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d255d43d-17b9-4456-b626-19bd3dec54b3 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:53.582308 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-d255d43d-17b9-4456-b626-19bd3dec54b3 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Getting quotas for project ebe5283d88b44f8b824c7bbca56b3473. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:39:53.586802 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-d255d43d-17b9-4456-b626-19bd3dec54b3 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Getting quotas for user 022c4688d9ce4df9a99ae5fa84e1d871 and project ebe5283d88b44f8b824c7bbca56b3473. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:39:53.647320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d255d43d-17b9-4456-b626-19bd3dec54b3 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Going to run 1 instances... {{(pid=128048) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:39:53.649843 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d255d43d-17b9-4456-b626-19bd3dec54b3 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e809d00f-5c75-4627-b573-208034333980',volume_size=None,volume_type=None)] {{(pid=128048) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:39:53.857306 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-751653b7-0fa5-4ef8-afd5-1ffd56e3953a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:53.857847 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-751653b7-0fa5-4ef8-afd5-1ffd56e3953a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:53.864280 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-751653b7-0fa5-4ef8-afd5-1ffd56e3953a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:53.864805 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-751653b7-0fa5-4ef8-afd5-1ffd56e3953a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:53.865245 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-751653b7-0fa5-4ef8-afd5-1ffd56e3953a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:53.866194 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-751653b7-0fa5-4ef8-afd5-1ffd56e3953a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:53.866841 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-751653b7-0fa5-4ef8-afd5-1ffd56e3953a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:53.867222 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-751653b7-0fa5-4ef8-afd5-1ffd56e3953a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:54.007495 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-751653b7-0fa5-4ef8-afd5-1ffd56e3953a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:54.015533 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-751653b7-0fa5-4ef8-afd5-1ffd56e3953a tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1687 microversion: 2.1 time: 0.162343 Aug 31 00:39:54.016098 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 300/596] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:53 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:54.149611 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d255d43d-17b9-4456-b626-19bd3dec54b3 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.123494 Aug 31 00:39:54.150169 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 297/597] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:39:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:39:54.161193 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-655822a3-d306-4c69-b29e-eb98d9f53fec tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:54.161808 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-655822a3-d306-4c69-b29e-eb98d9f53fec tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:54.221749 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-655822a3-d306-4c69-b29e-eb98d9f53fec tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:54.232447 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-655822a3-d306-4c69-b29e-eb98d9f53fec tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1095 microversion: 2.1 time: 0.074867 Aug 31 00:39:54.233282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 301/598] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:54 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:55.038975 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-b0cb52a6-25fb-4756-a17c-d71ca46cd404 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:55.039567 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-b0cb52a6-25fb-4756-a17c-d71ca46cd404 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:55.045981 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b0cb52a6-25fb-4756-a17c-d71ca46cd404 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:55.046537 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b0cb52a6-25fb-4756-a17c-d71ca46cd404 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:55.047019 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b0cb52a6-25fb-4756-a17c-d71ca46cd404 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:55.047793 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b0cb52a6-25fb-4756-a17c-d71ca46cd404 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:55.048286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b0cb52a6-25fb-4756-a17c-d71ca46cd404 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:55.048798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b0cb52a6-25fb-4756-a17c-d71ca46cd404 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:55.183659 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b0cb52a6-25fb-4756-a17c-d71ca46cd404 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:55.191619 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-b0cb52a6-25fb-4756-a17c-d71ca46cd404 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1687 microversion: 2.1 time: 0.157118 Aug 31 00:39:55.192197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 298/599] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:55 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:55.253504 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c39b45aa-9a7f-40d9-9493-2ff27e0c0c0d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:55.254112 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c39b45aa-9a7f-40d9-9493-2ff27e0c0c0d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:55.262299 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c39b45aa-9a7f-40d9-9493-2ff27e0c0c0d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:55.262783 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c39b45aa-9a7f-40d9-9493-2ff27e0c0c0d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:55.263213 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c39b45aa-9a7f-40d9-9493-2ff27e0c0c0d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:55.263906 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c39b45aa-9a7f-40d9-9493-2ff27e0c0c0d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:55.264389 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c39b45aa-9a7f-40d9-9493-2ff27e0c0c0d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:55.264816 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c39b45aa-9a7f-40d9-9493-2ff27e0c0c0d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:55.330692 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-c39b45aa-9a7f-40d9-9493-2ff27e0c0c0d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:55.339279 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c39b45aa-9a7f-40d9-9493-2ff27e0c0c0d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1145 microversion: 2.1 time: 0.089611 Aug 31 00:39:55.344683 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 302/600] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:55 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:56.214877 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-4a50687e-5d1b-4a4c-9617-b4038eaaaabb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:56.215583 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-4a50687e-5d1b-4a4c-9617-b4038eaaaabb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:56.221923 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4a50687e-5d1b-4a4c-9617-b4038eaaaabb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:56.222465 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4a50687e-5d1b-4a4c-9617-b4038eaaaabb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:56.222904 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4a50687e-5d1b-4a4c-9617-b4038eaaaabb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:56.223594 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4a50687e-5d1b-4a4c-9617-b4038eaaaabb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:56.224126 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4a50687e-5d1b-4a4c-9617-b4038eaaaabb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:56.224554 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4a50687e-5d1b-4a4c-9617-b4038eaaaabb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:56.359947 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b34c5173-49ed-46bf-9624-8fade1fcba4a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:56.361026 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-b34c5173-49ed-46bf-9624-8fade1fcba4a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:56.366579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4a50687e-5d1b-4a4c-9617-b4038eaaaabb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:56.369539 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b34c5173-49ed-46bf-9624-8fade1fcba4a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:56.370034 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b34c5173-49ed-46bf-9624-8fade1fcba4a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:56.371898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b34c5173-49ed-46bf-9624-8fade1fcba4a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:56.371898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b34c5173-49ed-46bf-9624-8fade1fcba4a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:56.371898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b34c5173-49ed-46bf-9624-8fade1fcba4a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:56.372164 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b34c5173-49ed-46bf-9624-8fade1fcba4a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:56.375816 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-4a50687e-5d1b-4a4c-9617-b4038eaaaabb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1687 microversion: 2.1 time: 0.164827 Aug 31 00:39:56.376438 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 299/601] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:56 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:39:56.436439 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-b34c5173-49ed-46bf-9624-8fade1fcba4a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:56.445191 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-b34c5173-49ed-46bf-9624-8fade1fcba4a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1145 microversion: 2.1 time: 0.088789 Aug 31 00:39:56.445805 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 303/602] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:56 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:39:57.399014 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c88005f0-c0f1-4e50-8771-70465c6313eb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:57.399841 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c88005f0-c0f1-4e50-8771-70465c6313eb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:57.406081 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c88005f0-c0f1-4e50-8771-70465c6313eb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:57.406911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c88005f0-c0f1-4e50-8771-70465c6313eb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:57.407555 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c88005f0-c0f1-4e50-8771-70465c6313eb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:57.408261 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c88005f0-c0f1-4e50-8771-70465c6313eb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:57.408840 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c88005f0-c0f1-4e50-8771-70465c6313eb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:57.409171 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c88005f0-c0f1-4e50-8771-70465c6313eb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:57.466841 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-86b5ac62-a30e-47b0-a0aa-21a4ecedc498 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:57.467455 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-86b5ac62-a30e-47b0-a0aa-21a4ecedc498 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:57.473833 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-86b5ac62-a30e-47b0-a0aa-21a4ecedc498 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:57.474314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-86b5ac62-a30e-47b0-a0aa-21a4ecedc498 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:57.474856 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-86b5ac62-a30e-47b0-a0aa-21a4ecedc498 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:57.476338 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-86b5ac62-a30e-47b0-a0aa-21a4ecedc498 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:57.476812 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-86b5ac62-a30e-47b0-a0aa-21a4ecedc498 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:57.477257 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-86b5ac62-a30e-47b0-a0aa-21a4ecedc498 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:57.542753 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-86b5ac62-a30e-47b0-a0aa-21a4ecedc498 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:57.551079 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-86b5ac62-a30e-47b0-a0aa-21a4ecedc498 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1193 microversion: 2.1 time: 0.088033 Aug 31 00:39:57.551668 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 304/603] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:57 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1193 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:57.805426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c88005f0-c0f1-4e50-8771-70465c6313eb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:57.813124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-c88005f0-c0f1-4e50-8771-70465c6313eb tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1687 microversion: 2.1 time: 0.419124 Aug 31 00:39:57.813696 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 300/604] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:57 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1687 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:58.173125 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-446d9bca-956c-4465-a489-0dc7dc4381b2 req-52329ac7-078e-48d6-b653-50697a799219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f8fa2f-7f69-4291-903c-1618b2c28146", "name": "network-vif-deleted", "tag": "28ac27c8-3511-439e-b159-a7d7f843ea7b"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:39:58.200085 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-446d9bca-956c-4465-a489-0dc7dc4381b2 req-52329ac7-078e-48d6-b653-50697a799219 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:58.201037 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-446d9bca-956c-4465-a489-0dc7dc4381b2 req-52329ac7-078e-48d6-b653-50697a799219 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:58.201645 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-446d9bca-956c-4465-a489-0dc7dc4381b2 req-52329ac7-078e-48d6-b653-50697a799219 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:58.223835 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-446d9bca-956c-4465-a489-0dc7dc4381b2 req-52329ac7-078e-48d6-b653-50697a799219 service nova] Creating event network-vif-deleted:28ac27c8-3511-439e-b159-a7d7f843ea7b for instance 95f8fa2f-7f69-4291-903c-1618b2c28146 on hv-cinder-85221 Aug 31 00:39:58.230945 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-446d9bca-956c-4465-a489-0dc7dc4381b2 req-52329ac7-078e-48d6-b653-50697a799219 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069208 Aug 31 00:39:58.232107 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 305/605] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:39:58.577851 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d2e7bf84-fa1b-442f-984d-edfff9b506b1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:58.578553 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d2e7bf84-fa1b-442f-984d-edfff9b506b1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:58.588946 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d2e7bf84-fa1b-442f-984d-edfff9b506b1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:58.588946 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d2e7bf84-fa1b-442f-984d-edfff9b506b1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:58.588946 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d2e7bf84-fa1b-442f-984d-edfff9b506b1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:58.588946 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d2e7bf84-fa1b-442f-984d-edfff9b506b1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:58.589377 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d2e7bf84-fa1b-442f-984d-edfff9b506b1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:58.589377 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d2e7bf84-fa1b-442f-984d-edfff9b506b1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:58.675096 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d2e7bf84-fa1b-442f-984d-edfff9b506b1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:58.685998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d2e7bf84-fa1b-442f-984d-edfff9b506b1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1211 microversion: 2.1 time: 0.113784 Aug 31 00:39:58.687314 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 301/606] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:58 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1211 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:58.836707 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-e8bb71de-9e4a-4148-a389-c92f96b7f54b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:58.837673 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-e8bb71de-9e4a-4148-a389-c92f96b7f54b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:58.844959 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e8bb71de-9e4a-4148-a389-c92f96b7f54b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:58.845787 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e8bb71de-9e4a-4148-a389-c92f96b7f54b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:58.846324 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e8bb71de-9e4a-4148-a389-c92f96b7f54b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:58.847417 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e8bb71de-9e4a-4148-a389-c92f96b7f54b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:58.847966 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e8bb71de-9e4a-4148-a389-c92f96b7f54b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:58.848556 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e8bb71de-9e4a-4148-a389-c92f96b7f54b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:58.885420 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e8bb71de-9e4a-4148-a389-c92f96b7f54b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:58.886112 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e8bb71de-9e4a-4148-a389-c92f96b7f54b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:58.887668 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e8bb71de-9e4a-4148-a389-c92f96b7f54b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:58.888185 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-e8bb71de-9e4a-4148-a389-c92f96b7f54b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lazy-loading 'fault' on Instance uuid 95f8fa2f-7f69-4291-903c-1618b2c28146 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:39:58.940822 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-e8bb71de-9e4a-4148-a389-c92f96b7f54b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:58.950811 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-e8bb71de-9e4a-4148-a389-c92f96b7f54b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1335 microversion: 2.1 time: 0.119096 Aug 31 00:39:58.951388 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 306/607] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:58 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1335 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:59.709342 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-702457dc-31a1-4b27-8572-74454a474695 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:59.710455 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-702457dc-31a1-4b27-8572-74454a474695 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:59.716811 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-702457dc-31a1-4b27-8572-74454a474695 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:59.717299 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-702457dc-31a1-4b27-8572-74454a474695 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:59.717739 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-702457dc-31a1-4b27-8572-74454a474695 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:59.718495 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-702457dc-31a1-4b27-8572-74454a474695 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:59.718917 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-702457dc-31a1-4b27-8572-74454a474695 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:59.719337 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-702457dc-31a1-4b27-8572-74454a474695 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:59.865328 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-702457dc-31a1-4b27-8572-74454a474695 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:39:59.874860 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-702457dc-31a1-4b27-8572-74454a474695 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1279 microversion: 2.1 time: 0.169202 Aug 31 00:39:59.886229 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 302/608] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:59 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:39:59.972694 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a6b5c4a4-da5c-4b48-98a1-ef2e98b83161 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:39:59.973479 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a6b5c4a4-da5c-4b48-98a1-ef2e98b83161 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:39:59.980791 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6b5c4a4-da5c-4b48-98a1-ef2e98b83161 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:59.981483 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6b5c4a4-da5c-4b48-98a1-ef2e98b83161 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:59.981910 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6b5c4a4-da5c-4b48-98a1-ef2e98b83161 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:39:59.982597 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6b5c4a4-da5c-4b48-98a1-ef2e98b83161 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:39:59.983040 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6b5c4a4-da5c-4b48-98a1-ef2e98b83161 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:39:59.983555 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6b5c4a4-da5c-4b48-98a1-ef2e98b83161 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:00.031018 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6b5c4a4-da5c-4b48-98a1-ef2e98b83161 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:00.031629 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6b5c4a4-da5c-4b48-98a1-ef2e98b83161 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:00.032136 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6b5c4a4-da5c-4b48-98a1-ef2e98b83161 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:00.032682 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-a6b5c4a4-da5c-4b48-98a1-ef2e98b83161 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lazy-loading 'fault' on Instance uuid 95f8fa2f-7f69-4291-903c-1618b2c28146 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:40:00.073506 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a6b5c4a4-da5c-4b48-98a1-ef2e98b83161 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:00.081827 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a6b5c4a4-da5c-4b48-98a1-ef2e98b83161 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 200 len: 1335 microversion: 2.1 time: 0.113139 Aug 31 00:40:00.082401 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 307/609] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:39:59 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 1335 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:00.252479 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-39ec9fec-c8a3-45ed-8d89-133a0f55850c req-36f467cd-16aa-4f83-a133-bdcab32aaee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747", "tag": "d40a5de5-de00-4fca-9d0f-1539d5f4fc04"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:00.263702 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-39ec9fec-c8a3-45ed-8d89-133a0f55850c req-36f467cd-16aa-4f83-a133-bdcab32aaee2 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:00.264189 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-39ec9fec-c8a3-45ed-8d89-133a0f55850c req-36f467cd-16aa-4f83-a133-bdcab32aaee2 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:00.264654 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-39ec9fec-c8a3-45ed-8d89-133a0f55850c req-36f467cd-16aa-4f83-a133-bdcab32aaee2 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:00.277902 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-39ec9fec-c8a3-45ed-8d89-133a0f55850c req-36f467cd-16aa-4f83-a133-bdcab32aaee2 service nova] Creating event network-changed:d40a5de5-de00-4fca-9d0f-1539d5f4fc04 for instance 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 on hv-cinder-85221 Aug 31 00:40:00.282603 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-39ec9fec-c8a3-45ed-8d89-133a0f55850c req-36f467cd-16aa-4f83-a133-bdcab32aaee2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033900 Aug 31 00:40:00.289974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 303/610] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:00.817685 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-e2e4f7d1-93ea-4b46-ab8f-96b9a698f816 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:00.818136 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-e2e4f7d1-93ea-4b46-ab8f-96b9a698f816 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:00.820702 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:40:00.821029 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Wed Aug 31 00:40:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3/action (ip 10.222.0.65) !!! Aug 31 00:40:00.826826 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e2e4f7d1-93ea-4b46-ab8f-96b9a698f816 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:00.832509 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e2e4f7d1-93ea-4b46-ab8f-96b9a698f816 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:00.832509 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e2e4f7d1-93ea-4b46-ab8f-96b9a698f816 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:00.832509 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e2e4f7d1-93ea-4b46-ab8f-96b9a698f816 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:00.832509 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e2e4f7d1-93ea-4b46-ab8f-96b9a698f816 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:00.832948 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e2e4f7d1-93ea-4b46-ab8f-96b9a698f816 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:00.854329 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-e2e4f7d1-93ea-4b46-ab8f-96b9a698f816 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lazy-loading 'flavor' on Instance uuid bce65669-d807-40a9-95e1-8cb85a0f03c3 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:40:00.896521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-58130d42-4dac-4804-9733-8866ba5450d6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:00.897911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-58130d42-4dac-4804-9733-8866ba5450d6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:00.899726 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:00.904807 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-58130d42-4dac-4804-9733-8866ba5450d6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:00.905288 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-58130d42-4dac-4804-9733-8866ba5450d6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:00.905719 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-58130d42-4dac-4804-9733-8866ba5450d6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:00.906404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-58130d42-4dac-4804-9733-8866ba5450d6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:00.906844 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-58130d42-4dac-4804-9733-8866ba5450d6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:00.907258 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-58130d42-4dac-4804-9733-8866ba5450d6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:01.045125 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-58130d42-4dac-4804-9733-8866ba5450d6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:01.053029 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-58130d42-4dac-4804-9733-8866ba5450d6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1267 microversion: 2.1 time: 0.160911 Aug 31 00:40:01.054179 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 304/611] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:00 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:01.103359 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-eed24723-96a3-4a1c-8717-7b7c66450c34 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:01.103957 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-eed24723-96a3-4a1c-8717-7b7c66450c34 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: 95f8fa2f-7f69-4291-903c-1618b2c28146] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:01.115293 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eed24723-96a3-4a1c-8717-7b7c66450c34 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:01.115293 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eed24723-96a3-4a1c-8717-7b7c66450c34 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:01.115293 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eed24723-96a3-4a1c-8717-7b7c66450c34 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:01.115293 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eed24723-96a3-4a1c-8717-7b7c66450c34 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:01.116354 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eed24723-96a3-4a1c-8717-7b7c66450c34 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:01.116354 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eed24723-96a3-4a1c-8717-7b7c66450c34 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:01.126329 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-eed24723-96a3-4a1c-8717-7b7c66450c34 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] HTTP exception thrown: Instance 95f8fa2f-7f69-4291-903c-1618b2c28146 could not be found. Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-eed24723-96a3-4a1c-8717-7b7c66450c34 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Request method failure captured: Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 HTTP/1.1 Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDqyzEg2Mk_Qrf-4ucl5mTksNAq4yJwZyFBzvEgaG-5wDv2_jHH3xLzlf6obMgJH9KOGrXwUBwxa_Key6OaUOrEfJ-OUrg1I_ZHusiecer0qLWJfeK6Wzpvtw2fZKiIczmma4oKpwrpEcygSzKn_2orgSwt38-qdaeq_LONkjXnfIEKU Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: d8aa6e0e8e6b492f8e74eea0e830c0bc Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1041420977 Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:40:01.127938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:40:01.129555 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:40:01.129555 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1041420977 Aug 31 00:40:01.129555 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: d8aa6e0e8e6b492f8e74eea0e830c0bc Aug 31 00:40:01.129555 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1041420977 Aug 31 00:40:01.129555 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-ServerRescueNegativeTestJSON-1041420977-project Aug 31 00:40:01.129555 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:40:01.129555 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:40:01.129555 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 77d23c99308c414f939761b07d329e03 Aug 31 00:40:01.129555 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1041420977-project Aug 31 00:40:01.129555 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:40:01.129555 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance 95f8fa2f-7f69-4291-903c-1618b2c28146 could not be found. Aug 31 00:40:01.129555 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': '95f8fa2f-7f69-4291-903c-1618b2c28146'} Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95f8fa2f-7f69-4291-903c-1618b2c28146 could not be found. Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:40:01.130271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:40:01.132156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:40:01.132156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:40:01.132156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:40:01.132156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:40:01.132156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:40:01.132156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:40:01.132156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:40:01.132156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95f8fa2f-7f69-4291-903c-1618b2c28146 could not be found. Aug 31 00:40:01.132156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:40:01.132156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:40:01.132156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:40:01.132156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:40:01.132156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:40:01.132156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:40:01.132156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:40:01.132156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:40:01.132156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95f8fa2f-7f69-4291-903c-1618b2c28146 could not be found. Aug 31 00:40:01.132156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:40:01.133497 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-eed24723-96a3-4a1c-8717-7b7c66450c34 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Returning 404 to user: Instance 95f8fa2f-7f69-4291-903c-1618b2c28146 could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:40:01.133497 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-eed24723-96a3-4a1c-8717-7b7c66450c34 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146" status: 404 len: 111 microversion: 2.1 time: 0.030159 Aug 31 00:40:01.133497 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 305/612] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:01 2022] GET /compute/v2.1/servers/95f8fa2f-7f69-4291-903c-1618b2c28146 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:40:01.138393 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f10979ee-af43-493b-a73a-f22865356bdd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '.version_select at 0x7f551ec04e50>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:01.203023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-e2e4f7d1-93ea-4b46-ab8f-96b9a698f816 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "POST /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3/action" status: 202 len: 0 microversion: 2.1 time: 0.389299 Aug 31 00:40:01.203606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 308/613] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 00:40:00 2022] POST /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:40:01.212216 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-86112eee-43ef-441b-800d-0d0126e47392 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:01.213423 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-86112eee-43ef-441b-800d-0d0126e47392 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:01.220176 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-86112eee-43ef-441b-800d-0d0126e47392 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:01.224386 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-86112eee-43ef-441b-800d-0d0126e47392 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:01.224386 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-86112eee-43ef-441b-800d-0d0126e47392 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:01.224595 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f10979ee-af43-493b-a73a-f22865356bdd tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845551870" status: 202 len: 0 microversion: 2.1 time: 0.087484 Aug 31 00:40:01.224680 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-86112eee-43ef-441b-800d-0d0126e47392 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:01.224779 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 306/614] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Aug 31 00:40:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845551870 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:40:01.224877 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-86112eee-43ef-441b-800d-0d0126e47392 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:01.224877 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-86112eee-43ef-441b-800d-0d0126e47392 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:01.243271 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:01.423711 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-86112eee-43ef-441b-800d-0d0126e47392 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:01.434501 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-86112eee-43ef-441b-800d-0d0126e47392 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.226214 Aug 31 00:40:01.439587 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 309/615] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:01 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:02.075096 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ae38117a-b36f-4fe9-8f2b-482f029915ad tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:02.075799 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ae38117a-b36f-4fe9-8f2b-482f029915ad tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:02.081787 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ae38117a-b36f-4fe9-8f2b-482f029915ad tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:02.087309 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ae38117a-b36f-4fe9-8f2b-482f029915ad tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:02.087309 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ae38117a-b36f-4fe9-8f2b-482f029915ad tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:02.087309 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ae38117a-b36f-4fe9-8f2b-482f029915ad tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:02.087309 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ae38117a-b36f-4fe9-8f2b-482f029915ad tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:02.087721 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ae38117a-b36f-4fe9-8f2b-482f029915ad tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:02.223357 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ae38117a-b36f-4fe9-8f2b-482f029915ad tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:02.231544 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ae38117a-b36f-4fe9-8f2b-482f029915ad tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1267 microversion: 2.1 time: 0.160287 Aug 31 00:40:02.232117 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 307/616] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:02 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:02.456902 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-85a1dc82-75ae-488f-ab0e-2c98e6f95c89 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:02.457503 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-85a1dc82-75ae-488f-ab0e-2c98e6f95c89 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:02.465374 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-85a1dc82-75ae-488f-ab0e-2c98e6f95c89 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:02.465852 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-85a1dc82-75ae-488f-ab0e-2c98e6f95c89 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:02.466282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-85a1dc82-75ae-488f-ab0e-2c98e6f95c89 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:02.466970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-85a1dc82-75ae-488f-ab0e-2c98e6f95c89 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:02.467471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-85a1dc82-75ae-488f-ab0e-2c98e6f95c89 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:02.467888 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-85a1dc82-75ae-488f-ab0e-2c98e6f95c89 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:02.611838 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-85a1dc82-75ae-488f-ab0e-2c98e6f95c89 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:02.620156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-85a1dc82-75ae-488f-ab0e-2c98e6f95c89 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.167150 Aug 31 00:40:02.620759 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 310/617] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:02 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:03.228092 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-3a91f3ba-c397-4212-8135-94278184db08 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:03.228092 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-3a91f3ba-c397-4212-8135-94278184db08 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:03.234241 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3a91f3ba-c397-4212-8135-94278184db08 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:03.234714 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3a91f3ba-c397-4212-8135-94278184db08 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:03.235167 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3a91f3ba-c397-4212-8135-94278184db08 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:03.235888 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3a91f3ba-c397-4212-8135-94278184db08 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:03.236348 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3a91f3ba-c397-4212-8135-94278184db08 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:03.236773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3a91f3ba-c397-4212-8135-94278184db08 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:03.252906 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f8aa0aa7-45a3-4228-9f5f-6604de267d75 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:03.253663 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f8aa0aa7-45a3-4228-9f5f-6604de267d75 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:03.260310 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f8aa0aa7-45a3-4228-9f5f-6604de267d75 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:03.260902 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f8aa0aa7-45a3-4228-9f5f-6604de267d75 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:03.261340 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f8aa0aa7-45a3-4228-9f5f-6604de267d75 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:03.262045 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f8aa0aa7-45a3-4228-9f5f-6604de267d75 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:03.262500 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f8aa0aa7-45a3-4228-9f5f-6604de267d75 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:03.262977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f8aa0aa7-45a3-4228-9f5f-6604de267d75 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:03.263783 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-3a91f3ba-c397-4212-8135-94278184db08 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd/ips" status: 200 len: 149 microversion: 2.1 time: 0.040329 Aug 31 00:40:03.264377 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 308/618] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 00:40:03 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:03.403046 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f8aa0aa7-45a3-4228-9f5f-6604de267d75 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:03.410958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f8aa0aa7-45a3-4228-9f5f-6604de267d75 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1267 microversion: 2.1 time: 0.161912 Aug 31 00:40:03.411523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 311/619] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:03 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:03.641438 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9842436b-e915-4229-99d9-c6870987755a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:03.642040 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9842436b-e915-4229-99d9-c6870987755a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:03.643945 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:03.644649 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=6 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:03.650057 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9842436b-e915-4229-99d9-c6870987755a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:03.650569 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9842436b-e915-4229-99d9-c6870987755a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:03.651021 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9842436b-e915-4229-99d9-c6870987755a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:03.651687 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9842436b-e915-4229-99d9-c6870987755a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:03.652144 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9842436b-e915-4229-99d9-c6870987755a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:03.652659 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9842436b-e915-4229-99d9-c6870987755a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:03.793541 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-9842436b-e915-4229-99d9-c6870987755a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:03.806167 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9842436b-e915-4229-99d9-c6870987755a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.163832 Aug 31 00:40:03.806167 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 309/620] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:03 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:04.433870 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-e085b43b-5cd3-4af1-8abc-f0612e3b5a82 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:04.434384 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-e085b43b-5cd3-4af1-8abc-f0612e3b5a82 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:04.436779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=2 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:04.441714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e085b43b-5cd3-4af1-8abc-f0612e3b5a82 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:04.442192 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e085b43b-5cd3-4af1-8abc-f0612e3b5a82 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:04.442632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e085b43b-5cd3-4af1-8abc-f0612e3b5a82 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:04.443340 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e085b43b-5cd3-4af1-8abc-f0612e3b5a82 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:04.443803 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e085b43b-5cd3-4af1-8abc-f0612e3b5a82 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:04.444376 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e085b43b-5cd3-4af1-8abc-f0612e3b5a82 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:04.584694 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-e085b43b-5cd3-4af1-8abc-f0612e3b5a82 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:04.595675 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-e085b43b-5cd3-4af1-8abc-f0612e3b5a82 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1267 microversion: 2.1 time: 0.166521 Aug 31 00:40:04.596258 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 312/621] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:04 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:04.825626 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-167f222b-3b19-4d4b-8af6-0d548d23755b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:04.826294 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-167f222b-3b19-4d4b-8af6-0d548d23755b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:04.832618 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-167f222b-3b19-4d4b-8af6-0d548d23755b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:04.833105 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-167f222b-3b19-4d4b-8af6-0d548d23755b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:04.833535 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-167f222b-3b19-4d4b-8af6-0d548d23755b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:04.834356 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-167f222b-3b19-4d4b-8af6-0d548d23755b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:04.834663 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-167f222b-3b19-4d4b-8af6-0d548d23755b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:04.835066 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-167f222b-3b19-4d4b-8af6-0d548d23755b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:04.858485 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a0dd1080-a63e-4d06-a579-3d546e2137de tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:04.858893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a0dd1080-a63e-4d06-a579-3d546e2137de tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:04.864918 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a0dd1080-a63e-4d06-a579-3d546e2137de tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:04.865405 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a0dd1080-a63e-4d06-a579-3d546e2137de tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:04.865854 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a0dd1080-a63e-4d06-a579-3d546e2137de tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:04.866582 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a0dd1080-a63e-4d06-a579-3d546e2137de tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:04.867189 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a0dd1080-a63e-4d06-a579-3d546e2137de tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:04.868050 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a0dd1080-a63e-4d06-a579-3d546e2137de tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:04.902565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a0dd1080-a63e-4d06-a579-3d546e2137de tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Going to try to terminate instance {{(pid=128049) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:40:04.981117 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-167f222b-3b19-4d4b-8af6-0d548d23755b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:04.987354 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-167f222b-3b19-4d4b-8af6-0d548d23755b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.165781 Aug 31 00:40:04.988521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 310/622] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:04 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:05.052719 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-09547fe6-48b1-4dc0-bdad-e75acc5ef78f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ee5c2f3-3730-4e11-b9a1-e79eda07da99"}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:05.055718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-09547fe6-48b1-4dc0-bdad-e75acc5ef78f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:05.062721 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-09547fe6-48b1-4dc0-bdad-e75acc5ef78f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:05.062721 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-09547fe6-48b1-4dc0-bdad-e75acc5ef78f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:05.063369 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-09547fe6-48b1-4dc0-bdad-e75acc5ef78f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:05.063704 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-09547fe6-48b1-4dc0-bdad-e75acc5ef78f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:05.063956 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-09547fe6-48b1-4dc0-bdad-e75acc5ef78f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:05.064400 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-09547fe6-48b1-4dc0-bdad-e75acc5ef78f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:05.139263 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=100 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:05.220344 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a0dd1080-a63e-4d06-a579-3d546e2137de tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 204 len: 0 microversion: 2.1 time: 0.365621 Aug 31 00:40:05.220973 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 313/623] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:40:04 2022] DELETE /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:40:05.229990 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-218d845b-4fe0-4cc4-b9db-9862c165a64b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:05.230534 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-218d845b-4fe0-4cc4-b9db-9862c165a64b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:05.236652 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-218d845b-4fe0-4cc4-b9db-9862c165a64b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:05.237126 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-218d845b-4fe0-4cc4-b9db-9862c165a64b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:05.237589 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-218d845b-4fe0-4cc4-b9db-9862c165a64b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:05.238285 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-218d845b-4fe0-4cc4-b9db-9862c165a64b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:05.238728 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-218d845b-4fe0-4cc4-b9db-9862c165a64b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:05.239145 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-218d845b-4fe0-4cc4-b9db-9862c165a64b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:05.375316 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-218d845b-4fe0-4cc4-b9db-9862c165a64b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:05.383968 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-218d845b-4fe0-4cc4-b9db-9862c165a64b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1506 microversion: 2.1 time: 0.158025 Aug 31 00:40:05.384604 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 314/624] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:05 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:05.616883 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3eb26f5a-e421-457a-8b4a-b2978ac6214f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:05.618427 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-3eb26f5a-e421-457a-8b4a-b2978ac6214f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:05.625072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3eb26f5a-e421-457a-8b4a-b2978ac6214f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:05.625650 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3eb26f5a-e421-457a-8b4a-b2978ac6214f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:05.626086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3eb26f5a-e421-457a-8b4a-b2978ac6214f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:05.626810 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3eb26f5a-e421-457a-8b4a-b2978ac6214f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:05.627257 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3eb26f5a-e421-457a-8b4a-b2978ac6214f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:05.627677 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3eb26f5a-e421-457a-8b4a-b2978ac6214f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:05.766232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-3eb26f5a-e421-457a-8b4a-b2978ac6214f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:05.773981 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-3eb26f5a-e421-457a-8b4a-b2978ac6214f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1267 microversion: 2.1 time: 0.161074 Aug 31 00:40:05.774802 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 315/625] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:05 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:06.010439 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c3a0aaf1-bd37-4865-ba4f-b4c3bdf1bdcb tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:06.011034 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c3a0aaf1-bd37-4865-ba4f-b4c3bdf1bdcb tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:06.017030 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c3a0aaf1-bd37-4865-ba4f-b4c3bdf1bdcb tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:06.017504 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c3a0aaf1-bd37-4865-ba4f-b4c3bdf1bdcb tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:06.017927 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c3a0aaf1-bd37-4865-ba4f-b4c3bdf1bdcb tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:06.018601 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c3a0aaf1-bd37-4865-ba4f-b4c3bdf1bdcb tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:06.019042 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c3a0aaf1-bd37-4865-ba4f-b4c3bdf1bdcb tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:06.019455 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c3a0aaf1-bd37-4865-ba4f-b4c3bdf1bdcb tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:06.152737 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-c3a0aaf1-bd37-4865-ba4f-b4c3bdf1bdcb tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:06.160765 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c3a0aaf1-bd37-4865-ba4f-b4c3bdf1bdcb tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.154287 Aug 31 00:40:06.161332 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 316/626] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:06 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:06.409891 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b51143ae-be63-4414-a6da-877059f2212e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:06.410425 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-b51143ae-be63-4414-a6da-877059f2212e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:06.417232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b51143ae-be63-4414-a6da-877059f2212e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:06.417711 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b51143ae-be63-4414-a6da-877059f2212e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:06.418589 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b51143ae-be63-4414-a6da-877059f2212e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:06.419291 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b51143ae-be63-4414-a6da-877059f2212e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:06.419736 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b51143ae-be63-4414-a6da-877059f2212e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:06.420159 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b51143ae-be63-4414-a6da-877059f2212e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:06.559458 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-b51143ae-be63-4414-a6da-877059f2212e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:06.567339 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-b51143ae-be63-4414-a6da-877059f2212e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1506 microversion: 2.1 time: 0.162585 Aug 31 00:40:06.567896 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 317/627] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:06 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:06.795753 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ee8f78f4-93dc-4463-83e0-6b8a3ee4af81 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:06.796425 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ee8f78f4-93dc-4463-83e0-6b8a3ee4af81 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:06.803411 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ee8f78f4-93dc-4463-83e0-6b8a3ee4af81 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:06.803888 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ee8f78f4-93dc-4463-83e0-6b8a3ee4af81 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:06.804338 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ee8f78f4-93dc-4463-83e0-6b8a3ee4af81 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:06.805638 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ee8f78f4-93dc-4463-83e0-6b8a3ee4af81 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:06.806431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ee8f78f4-93dc-4463-83e0-6b8a3ee4af81 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:06.806896 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ee8f78f4-93dc-4463-83e0-6b8a3ee4af81 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:06.945384 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ee8f78f4-93dc-4463-83e0-6b8a3ee4af81 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:06.953374 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ee8f78f4-93dc-4463-83e0-6b8a3ee4af81 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1267 microversion: 2.1 time: 0.161558 Aug 31 00:40:06.953948 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 318/628] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:06 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:07.182181 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-e420876e-3fde-43ab-974c-236a515ba987 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:07.182695 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-e420876e-3fde-43ab-974c-236a515ba987 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:07.188735 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e420876e-3fde-43ab-974c-236a515ba987 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:07.189211 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e420876e-3fde-43ab-974c-236a515ba987 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:07.189636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e420876e-3fde-43ab-974c-236a515ba987 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:07.190386 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e420876e-3fde-43ab-974c-236a515ba987 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:07.191005 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e420876e-3fde-43ab-974c-236a515ba987 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:07.191426 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e420876e-3fde-43ab-974c-236a515ba987 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:07.332159 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-e420876e-3fde-43ab-974c-236a515ba987 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:07.341176 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-e420876e-3fde-43ab-974c-236a515ba987 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.163030 Aug 31 00:40:07.341801 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 319/629] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:07 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:07.590341 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d73e32ce-3ad8-400e-9783-ab6a5fa99e2b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:07.590952 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d73e32ce-3ad8-400e-9783-ab6a5fa99e2b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:07.597043 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d73e32ce-3ad8-400e-9783-ab6a5fa99e2b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:07.597532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d73e32ce-3ad8-400e-9783-ab6a5fa99e2b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:07.597968 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d73e32ce-3ad8-400e-9783-ab6a5fa99e2b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:07.598733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d73e32ce-3ad8-400e-9783-ab6a5fa99e2b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:07.599195 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d73e32ce-3ad8-400e-9783-ab6a5fa99e2b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:07.599615 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d73e32ce-3ad8-400e-9783-ab6a5fa99e2b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:07.741320 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d73e32ce-3ad8-400e-9783-ab6a5fa99e2b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:07.749885 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d73e32ce-3ad8-400e-9783-ab6a5fa99e2b tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1506 microversion: 2.1 time: 0.164054 Aug 31 00:40:07.750411 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 320/630] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:07 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:07.974977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f7fd459a-8850-462e-aabb-49ba93f5fb85 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:07.975600 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f7fd459a-8850-462e-aabb-49ba93f5fb85 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:07.982409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f7fd459a-8850-462e-aabb-49ba93f5fb85 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:07.984721 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f7fd459a-8850-462e-aabb-49ba93f5fb85 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:07.984721 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f7fd459a-8850-462e-aabb-49ba93f5fb85 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:07.984721 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f7fd459a-8850-462e-aabb-49ba93f5fb85 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:07.984721 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f7fd459a-8850-462e-aabb-49ba93f5fb85 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:07.985100 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f7fd459a-8850-462e-aabb-49ba93f5fb85 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:08.123684 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f7fd459a-8850-462e-aabb-49ba93f5fb85 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:08.131807 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f7fd459a-8850-462e-aabb-49ba93f5fb85 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1267 microversion: 2.1 time: 0.160660 Aug 31 00:40:08.132402 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 321/631] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:07 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:08.363656 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-17293b97-1e80-4b82-b599-54e596dd40ac tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:08.364221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-17293b97-1e80-4b82-b599-54e596dd40ac tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:08.370749 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-17293b97-1e80-4b82-b599-54e596dd40ac tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:08.371229 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-17293b97-1e80-4b82-b599-54e596dd40ac tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:08.376388 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-17293b97-1e80-4b82-b599-54e596dd40ac tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:08.376388 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-17293b97-1e80-4b82-b599-54e596dd40ac tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:08.376388 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-17293b97-1e80-4b82-b599-54e596dd40ac tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:08.376388 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-17293b97-1e80-4b82-b599-54e596dd40ac tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:08.402828 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-09547fe6-48b1-4dc0-bdad-e75acc5ef78f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "POST /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.354098 Aug 31 00:40:08.403591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 311/632] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 00:40:05 2022] POST /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd/os-volume_attachments => generated 194 bytes in 3356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:08.544165 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-17293b97-1e80-4b82-b599-54e596dd40ac tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:08.551998 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-17293b97-1e80-4b82-b599-54e596dd40ac tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.192297 Aug 31 00:40:08.552596 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 322/633] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:08 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:08.772195 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-012d4ee9-12a7-4f9b-aaf4-12b89f8cacc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:08.772970 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-012d4ee9-12a7-4f9b-aaf4-12b89f8cacc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:08.779703 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-012d4ee9-12a7-4f9b-aaf4-12b89f8cacc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:08.780197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-012d4ee9-12a7-4f9b-aaf4-12b89f8cacc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:08.780666 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-012d4ee9-12a7-4f9b-aaf4-12b89f8cacc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:08.781882 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-012d4ee9-12a7-4f9b-aaf4-12b89f8cacc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:08.781882 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-012d4ee9-12a7-4f9b-aaf4-12b89f8cacc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:08.782472 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-012d4ee9-12a7-4f9b-aaf4-12b89f8cacc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:09.016014 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-012d4ee9-12a7-4f9b-aaf4-12b89f8cacc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:09.023831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-012d4ee9-12a7-4f9b-aaf4-12b89f8cacc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1506 microversion: 2.1 time: 0.255893 Aug 31 00:40:09.024751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 312/634] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:08 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:09.152880 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ed771d29-0744-48bd-9215-078988367bff tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:09.153522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ed771d29-0744-48bd-9215-078988367bff tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:09.161033 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ed771d29-0744-48bd-9215-078988367bff tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:09.161466 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ed771d29-0744-48bd-9215-078988367bff tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:09.161961 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ed771d29-0744-48bd-9215-078988367bff tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:09.162367 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ed771d29-0744-48bd-9215-078988367bff tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:09.165140 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ed771d29-0744-48bd-9215-078988367bff tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:09.165140 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ed771d29-0744-48bd-9215-078988367bff tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:09.319571 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ed771d29-0744-48bd-9215-078988367bff tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:09.329677 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ed771d29-0744-48bd-9215-078988367bff tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1267 microversion: 2.1 time: 0.180936 Aug 31 00:40:09.332267 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 323/635] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:09 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:09.356481 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-f7f9353b-2361-4796-9157-99de0ec0e8ee req-e3c06f2b-74de-457e-a542-c95ab02e57f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6fcd7c-4829-401e-88dc-0520b01562ff", "name": "network-vif-deleted", "tag": "79a597d8-aec3-4139-9872-88eb69cbc272"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:09.366429 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-f7f9353b-2361-4796-9157-99de0ec0e8ee req-e3c06f2b-74de-457e-a542-c95ab02e57f7 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:09.366947 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-f7f9353b-2361-4796-9157-99de0ec0e8ee req-e3c06f2b-74de-457e-a542-c95ab02e57f7 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:09.367381 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-f7f9353b-2361-4796-9157-99de0ec0e8ee req-e3c06f2b-74de-457e-a542-c95ab02e57f7 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:09.378837 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-f7f9353b-2361-4796-9157-99de0ec0e8ee req-e3c06f2b-74de-457e-a542-c95ab02e57f7 service nova] Creating event network-vif-deleted:79a597d8-aec3-4139-9872-88eb69cbc272 for instance ca6fcd7c-4829-401e-88dc-0520b01562ff on hv-cinder-85221 Aug 31 00:40:09.383847 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-f7f9353b-2361-4796-9157-99de0ec0e8ee req-e3c06f2b-74de-457e-a542-c95ab02e57f7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031761 Aug 31 00:40:09.384441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 313/636] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:09.575421 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-19081815-ec21-4cc4-a259-4d7dfbd724e5 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:09.576039 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-19081815-ec21-4cc4-a259-4d7dfbd724e5 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:09.582271 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-19081815-ec21-4cc4-a259-4d7dfbd724e5 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:09.582786 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-19081815-ec21-4cc4-a259-4d7dfbd724e5 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:09.583301 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-19081815-ec21-4cc4-a259-4d7dfbd724e5 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:09.583924 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-19081815-ec21-4cc4-a259-4d7dfbd724e5 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:09.584398 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-19081815-ec21-4cc4-a259-4d7dfbd724e5 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:09.584824 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-19081815-ec21-4cc4-a259-4d7dfbd724e5 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:09.602370 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:09.753156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-19081815-ec21-4cc4-a259-4d7dfbd724e5 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:09.762510 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-19081815-ec21-4cc4-a259-4d7dfbd724e5 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.191957 Aug 31 00:40:09.763091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 324/637] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:09 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:10.051133 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-aa779e7d-e4a7-4bfa-a7b8-d19a28a5a397 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:10.051909 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-aa779e7d-e4a7-4bfa-a7b8-d19a28a5a397 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:10.059280 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aa779e7d-e4a7-4bfa-a7b8-d19a28a5a397 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:10.059754 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aa779e7d-e4a7-4bfa-a7b8-d19a28a5a397 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:10.060181 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aa779e7d-e4a7-4bfa-a7b8-d19a28a5a397 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:10.060967 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aa779e7d-e4a7-4bfa-a7b8-d19a28a5a397 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:10.061411 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aa779e7d-e4a7-4bfa-a7b8-d19a28a5a397 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:10.061824 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aa779e7d-e4a7-4bfa-a7b8-d19a28a5a397 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:10.105461 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aa779e7d-e4a7-4bfa-a7b8-d19a28a5a397 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:10.106013 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aa779e7d-e4a7-4bfa-a7b8-d19a28a5a397 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:10.106397 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aa779e7d-e4a7-4bfa-a7b8-d19a28a5a397 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:10.106852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-aa779e7d-e4a7-4bfa-a7b8-d19a28a5a397 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lazy-loading 'fault' on Instance uuid ca6fcd7c-4829-401e-88dc-0520b01562ff {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:40:10.160142 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-aa779e7d-e4a7-4bfa-a7b8-d19a28a5a397 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:10.169011 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-aa779e7d-e4a7-4bfa-a7b8-d19a28a5a397 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 200 len: 1311 microversion: 2.1 time: 0.125288 Aug 31 00:40:10.169585 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 314/638] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:10 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 1311 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:10.353492 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-36b6d2ed-f5e0-4eda-8096-f4839b4b2038 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:10.354073 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-36b6d2ed-f5e0-4eda-8096-f4839b4b2038 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:10.361333 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-36b6d2ed-f5e0-4eda-8096-f4839b4b2038 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:10.361868 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-36b6d2ed-f5e0-4eda-8096-f4839b4b2038 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:10.362341 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-36b6d2ed-f5e0-4eda-8096-f4839b4b2038 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:10.363036 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-36b6d2ed-f5e0-4eda-8096-f4839b4b2038 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:10.363482 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-36b6d2ed-f5e0-4eda-8096-f4839b4b2038 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:10.363903 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-36b6d2ed-f5e0-4eda-8096-f4839b4b2038 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:10.507445 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-36b6d2ed-f5e0-4eda-8096-f4839b4b2038 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:10.516998 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-36b6d2ed-f5e0-4eda-8096-f4839b4b2038 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1267 microversion: 2.1 time: 0.168355 Aug 31 00:40:10.517743 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 325/639] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:10 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:10.785984 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-b087710e-f2f1-4bc2-b43a-56ac2af421ef tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:10.787120 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-b087710e-f2f1-4bc2-b43a-56ac2af421ef tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:10.794033 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b087710e-f2f1-4bc2-b43a-56ac2af421ef tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:10.794886 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b087710e-f2f1-4bc2-b43a-56ac2af421ef tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:10.795582 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b087710e-f2f1-4bc2-b43a-56ac2af421ef tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:10.796709 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b087710e-f2f1-4bc2-b43a-56ac2af421ef tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:10.797388 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b087710e-f2f1-4bc2-b43a-56ac2af421ef tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:10.798014 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b087710e-f2f1-4bc2-b43a-56ac2af421ef tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:10.943956 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b087710e-f2f1-4bc2-b43a-56ac2af421ef tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:10.953652 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-b087710e-f2f1-4bc2-b43a-56ac2af421ef tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.171723 Aug 31 00:40:10.954472 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 315/640] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:10 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:11.191351 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-30119312-a6c5-448e-ade6-c03ce6e5dcc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:11.191873 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-30119312-a6c5-448e-ade6-c03ce6e5dcc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: ca6fcd7c-4829-401e-88dc-0520b01562ff] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:11.198854 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-30119312-a6c5-448e-ade6-c03ce6e5dcc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:11.199344 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-30119312-a6c5-448e-ade6-c03ce6e5dcc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:11.199783 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-30119312-a6c5-448e-ade6-c03ce6e5dcc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:11.200520 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-30119312-a6c5-448e-ade6-c03ce6e5dcc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:11.200973 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-30119312-a6c5-448e-ade6-c03ce6e5dcc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:11.201456 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-30119312-a6c5-448e-ade6-c03ce6e5dcc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:11.217496 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-30119312-a6c5-448e-ade6-c03ce6e5dcc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] HTTP exception thrown: Instance ca6fcd7c-4829-401e-88dc-0520b01562ff could not be found. Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-30119312-a6c5-448e-ade6-c03ce6e5dcc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Request method failure captured: Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff HTTP/1.1 Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqyzEg2Mk_Qrf-4ucl5mTksNAq4yJwZyFBzvEgaG-5wDv2_jHH3xLzlf6obMgJH9KOGrXwUBwxa_Key6OaUOrEfJ-OUrg1I_ZHusiecer0qLWJfeK6Wzpvtw2fZKiIczmma4oKpwrpEcygSzKn_2orgSwt38-qdaeq_LONkjXnfIEKU Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: d8aa6e0e8e6b492f8e74eea0e830c0bc Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1041420977 Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:40:11.219146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:40:11.220522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:40:11.220522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1041420977 Aug 31 00:40:11.220522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: d8aa6e0e8e6b492f8e74eea0e830c0bc Aug 31 00:40:11.220522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1041420977 Aug 31 00:40:11.220522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-ServerRescueNegativeTestJSON-1041420977-project Aug 31 00:40:11.220522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:40:11.220522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:40:11.220522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 77d23c99308c414f939761b07d329e03 Aug 31 00:40:11.220522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1041420977-project Aug 31 00:40:11.220522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:40:11.220522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance ca6fcd7c-4829-401e-88dc-0520b01562ff could not be found. Aug 31 00:40:11.220522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': 'ca6fcd7c-4829-401e-88dc-0520b01562ff'} Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca6fcd7c-4829-401e-88dc-0520b01562ff could not be found. Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:40:11.221232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:40:11.222548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:40:11.222548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:40:11.222548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:40:11.222548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:40:11.222548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:40:11.222548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:40:11.222548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:40:11.222548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca6fcd7c-4829-401e-88dc-0520b01562ff could not be found. Aug 31 00:40:11.222548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:11.222548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:40:11.222548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:11.222548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:40:11.222548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:40:11.222548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:40:11.222548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:40:11.222548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:40:11.222548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca6fcd7c-4829-401e-88dc-0520b01562ff could not be found. Aug 31 00:40:11.222548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:11.223762 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-30119312-a6c5-448e-ade6-c03ce6e5dcc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Returning 404 to user: Instance ca6fcd7c-4829-401e-88dc-0520b01562ff could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:40:11.223762 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-30119312-a6c5-448e-ade6-c03ce6e5dcc3 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff" status: 404 len: 111 microversion: 2.1 time: 0.033254 Aug 31 00:40:11.223762 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 326/641] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:11 2022] GET /compute/v2.1/servers/ca6fcd7c-4829-401e-88dc-0520b01562ff => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:40:11.229852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-2f5642fa-9a3e-476c-9a9b-34f11752c47c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:11.230687 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-2f5642fa-9a3e-476c-9a9b-34f11752c47c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:11.236827 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2f5642fa-9a3e-476c-9a9b-34f11752c47c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:11.237312 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2f5642fa-9a3e-476c-9a9b-34f11752c47c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:11.237754 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2f5642fa-9a3e-476c-9a9b-34f11752c47c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:11.238441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2f5642fa-9a3e-476c-9a9b-34f11752c47c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:11.238898 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2f5642fa-9a3e-476c-9a9b-34f11752c47c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:11.239341 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2f5642fa-9a3e-476c-9a9b-34f11752c47c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:11.266296 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-2f5642fa-9a3e-476c-9a9b-34f11752c47c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Going to try to terminate instance {{(pid=128048) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:40:11.538874 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-44291419-8f1b-4a5d-8c01-5a8727949f2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:11.539612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-44291419-8f1b-4a5d-8c01-5a8727949f2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:11.546627 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-44291419-8f1b-4a5d-8c01-5a8727949f2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:11.547117 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-44291419-8f1b-4a5d-8c01-5a8727949f2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:11.547560 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-44291419-8f1b-4a5d-8c01-5a8727949f2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:11.548251 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-44291419-8f1b-4a5d-8c01-5a8727949f2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:11.548729 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-44291419-8f1b-4a5d-8c01-5a8727949f2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:11.549149 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-44291419-8f1b-4a5d-8c01-5a8727949f2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:11.622550 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-2f5642fa-9a3e-476c-9a9b-34f11752c47c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 204 len: 0 microversion: 2.1 time: 0.396214 Aug 31 00:40:11.623595 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 316/642] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:40:11 2022] DELETE /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:40:11.637612 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-8b236126-fcdc-40f4-93b7-91d76b9aa11c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:11.638518 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-8b236126-fcdc-40f4-93b7-91d76b9aa11c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:11.646451 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8b236126-fcdc-40f4-93b7-91d76b9aa11c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:11.647224 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8b236126-fcdc-40f4-93b7-91d76b9aa11c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:11.647545 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8b236126-fcdc-40f4-93b7-91d76b9aa11c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:11.648285 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8b236126-fcdc-40f4-93b7-91d76b9aa11c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:11.648912 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8b236126-fcdc-40f4-93b7-91d76b9aa11c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:11.649602 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8b236126-fcdc-40f4-93b7-91d76b9aa11c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:11.711735 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-44291419-8f1b-4a5d-8c01-5a8727949f2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:11.724993 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-44291419-8f1b-4a5d-8c01-5a8727949f2b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1267 microversion: 2.1 time: 0.189437 Aug 31 00:40:11.726030 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 327/643] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:11 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:11.808105 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-8b236126-fcdc-40f4-93b7-91d76b9aa11c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:11.816136 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-8b236126-fcdc-40f4-93b7-91d76b9aa11c tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.186628 Aug 31 00:40:11.816729 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 317/644] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:11 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:11.975707 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d0ce124a-e352-4acc-86c1-3d2a258ebead tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:11.976345 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d0ce124a-e352-4acc-86c1-3d2a258ebead tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:11.983056 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0ce124a-e352-4acc-86c1-3d2a258ebead tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:11.983625 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0ce124a-e352-4acc-86c1-3d2a258ebead tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:11.984053 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0ce124a-e352-4acc-86c1-3d2a258ebead tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:11.984768 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0ce124a-e352-4acc-86c1-3d2a258ebead tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:11.985214 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0ce124a-e352-4acc-86c1-3d2a258ebead tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:11.985631 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0ce124a-e352-4acc-86c1-3d2a258ebead tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:12.049242 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-64f0e384-8627-400f-a003-bf1019cb3002 req-2f7ffb20-0328-4118-914a-9c53616297ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747", "name": "network-vif-plugged", "status": "completed", "tag": "d40a5de5-de00-4fca-9d0f-1539d5f4fc04"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:12.061336 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-64f0e384-8627-400f-a003-bf1019cb3002 req-2f7ffb20-0328-4118-914a-9c53616297ca service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:12.061816 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-64f0e384-8627-400f-a003-bf1019cb3002 req-2f7ffb20-0328-4118-914a-9c53616297ca service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:12.062242 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-64f0e384-8627-400f-a003-bf1019cb3002 req-2f7ffb20-0328-4118-914a-9c53616297ca service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:12.074100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-64f0e384-8627-400f-a003-bf1019cb3002 req-2f7ffb20-0328-4118-914a-9c53616297ca service nova] Creating event network-vif-plugged:d40a5de5-de00-4fca-9d0f-1539d5f4fc04 for instance 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 on hv-cinder-85221 Aug 31 00:40:12.079128 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-64f0e384-8627-400f-a003-bf1019cb3002 req-2f7ffb20-0328-4118-914a-9c53616297ca service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034319 Aug 31 00:40:12.079724 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 318/645] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:12.127570 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d0ce124a-e352-4acc-86c1-3d2a258ebead tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:12.135573 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d0ce124a-e352-4acc-86c1-3d2a258ebead tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.164058 Aug 31 00:40:12.136172 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 328/646] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:11 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:12.750574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-2a43415a-d356-4164-9819-2ba735fd023c tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:12.751262 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-2a43415a-d356-4164-9819-2ba735fd023c tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:12.757529 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2a43415a-d356-4164-9819-2ba735fd023c tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:12.758023 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2a43415a-d356-4164-9819-2ba735fd023c tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:12.758669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2a43415a-d356-4164-9819-2ba735fd023c tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:12.759383 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2a43415a-d356-4164-9819-2ba735fd023c tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:12.759839 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2a43415a-d356-4164-9819-2ba735fd023c tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:12.760265 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2a43415a-d356-4164-9819-2ba735fd023c tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:12.838089 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b6ae012b-c464-4638-97c4-d794b7790497 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:12.838767 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-b6ae012b-c464-4638-97c4-d794b7790497 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:12.845559 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b6ae012b-c464-4638-97c4-d794b7790497 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:12.846050 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b6ae012b-c464-4638-97c4-d794b7790497 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:12.846644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b6ae012b-c464-4638-97c4-d794b7790497 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:12.847211 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b6ae012b-c464-4638-97c4-d794b7790497 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:12.847666 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b6ae012b-c464-4638-97c4-d794b7790497 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:12.848086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b6ae012b-c464-4638-97c4-d794b7790497 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:12.905243 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-2a43415a-d356-4164-9819-2ba735fd023c tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:12.913830 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-2a43415a-d356-4164-9819-2ba735fd023c tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1267 microversion: 2.1 time: 0.167895 Aug 31 00:40:12.914482 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 319/647] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:12 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:12.985424 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-b6ae012b-c464-4638-97c4-d794b7790497 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:12.994202 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-b6ae012b-c464-4638-97c4-d794b7790497 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.160245 Aug 31 00:40:12.994784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 329/648] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:12 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:13.157811 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f69db45d-b26c-4961-baf3-ea33442c2e18 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:13.158315 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-f69db45d-b26c-4961-baf3-ea33442c2e18 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:13.164278 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f69db45d-b26c-4961-baf3-ea33442c2e18 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:13.164781 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f69db45d-b26c-4961-baf3-ea33442c2e18 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:13.165206 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f69db45d-b26c-4961-baf3-ea33442c2e18 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:13.165886 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f69db45d-b26c-4961-baf3-ea33442c2e18 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:13.166327 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f69db45d-b26c-4961-baf3-ea33442c2e18 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:13.166772 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f69db45d-b26c-4961-baf3-ea33442c2e18 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:13.302594 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f69db45d-b26c-4961-baf3-ea33442c2e18 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:13.311340 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f69db45d-b26c-4961-baf3-ea33442c2e18 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.157574 Aug 31 00:40:13.311907 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 320/649] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:13 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:13.935539 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-59826535-a0a4-4981-993c-fd95876253e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:13.936149 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-59826535-a0a4-4981-993c-fd95876253e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:13.943012 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-59826535-a0a4-4981-993c-fd95876253e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:13.943494 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-59826535-a0a4-4981-993c-fd95876253e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:13.943938 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-59826535-a0a4-4981-993c-fd95876253e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:13.944927 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-59826535-a0a4-4981-993c-fd95876253e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:13.945485 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-59826535-a0a4-4981-993c-fd95876253e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:13.945907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-59826535-a0a4-4981-993c-fd95876253e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:14.015149 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ae384542-247d-4bf3-965f-515cce584cc9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:14.015873 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ae384542-247d-4bf3-965f-515cce584cc9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:14.022420 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ae384542-247d-4bf3-965f-515cce584cc9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:14.022902 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ae384542-247d-4bf3-965f-515cce584cc9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:14.023336 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ae384542-247d-4bf3-965f-515cce584cc9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:14.024032 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ae384542-247d-4bf3-965f-515cce584cc9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:14.025340 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ae384542-247d-4bf3-965f-515cce584cc9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:14.025828 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ae384542-247d-4bf3-965f-515cce584cc9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:14.089307 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-59826535-a0a4-4981-993c-fd95876253e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:14.097432 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-59826535-a0a4-4981-993c-fd95876253e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1267 microversion: 2.1 time: 0.165878 Aug 31 00:40:14.098005 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 330/650] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:13 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:14.164214 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ae384542-247d-4bf3-965f-515cce584cc9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:14.172401 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ae384542-247d-4bf3-965f-515cce584cc9 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.161076 Aug 31 00:40:14.172966 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 321/651] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:14 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:14.333846 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-33daec2a-ebe3-458f-9f2e-5382b3c7ef4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:14.334490 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-33daec2a-ebe3-458f-9f2e-5382b3c7ef4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:14.341076 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-33daec2a-ebe3-458f-9f2e-5382b3c7ef4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:14.341529 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-33daec2a-ebe3-458f-9f2e-5382b3c7ef4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:14.341963 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-33daec2a-ebe3-458f-9f2e-5382b3c7ef4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:14.342717 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-33daec2a-ebe3-458f-9f2e-5382b3c7ef4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:14.343171 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-33daec2a-ebe3-458f-9f2e-5382b3c7ef4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:14.343597 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-33daec2a-ebe3-458f-9f2e-5382b3c7ef4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:14.480211 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-33daec2a-ebe3-458f-9f2e-5382b3c7ef4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:14.488142 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-33daec2a-ebe3-458f-9f2e-5382b3c7ef4d tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.158359 Aug 31 00:40:14.488747 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 331/652] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:14 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:15.120595 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c9a8aaf8-bc2f-4a8f-bdee-760a39993ac7 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:15.121191 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c9a8aaf8-bc2f-4a8f-bdee-760a39993ac7 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:15.127749 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c9a8aaf8-bc2f-4a8f-bdee-760a39993ac7 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:15.128218 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c9a8aaf8-bc2f-4a8f-bdee-760a39993ac7 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:15.128674 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c9a8aaf8-bc2f-4a8f-bdee-760a39993ac7 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:15.129356 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c9a8aaf8-bc2f-4a8f-bdee-760a39993ac7 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:15.129813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c9a8aaf8-bc2f-4a8f-bdee-760a39993ac7 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:15.130214 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c9a8aaf8-bc2f-4a8f-bdee-760a39993ac7 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:15.195508 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-bf2d5261-fdd0-4256-ae79-41a4014321e6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:15.196122 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-bf2d5261-fdd0-4256-ae79-41a4014321e6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:15.203067 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf2d5261-fdd0-4256-ae79-41a4014321e6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:15.203547 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf2d5261-fdd0-4256-ae79-41a4014321e6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:15.203993 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf2d5261-fdd0-4256-ae79-41a4014321e6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:15.204694 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf2d5261-fdd0-4256-ae79-41a4014321e6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:15.205137 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf2d5261-fdd0-4256-ae79-41a4014321e6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:15.205576 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf2d5261-fdd0-4256-ae79-41a4014321e6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:15.270853 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c9a8aaf8-bc2f-4a8f-bdee-760a39993ac7 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:15.279584 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-c9a8aaf8-bc2f-4a8f-bdee-760a39993ac7 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1267 microversion: 2.1 time: 0.164372 Aug 31 00:40:15.282590 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 322/653] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:15 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:15.347418 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-bf2d5261-fdd0-4256-ae79-41a4014321e6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:15.357564 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-bf2d5261-fdd0-4256-ae79-41a4014321e6 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1521 microversion: 2.1 time: 0.166347 Aug 31 00:40:15.358181 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 332/654] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:15 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:15.509882 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-68bbadb4-f257-4f3f-ae44-e9bbb184604c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:15.510491 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-68bbadb4-f257-4f3f-ae44-e9bbb184604c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:15.516415 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-68bbadb4-f257-4f3f-ae44-e9bbb184604c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:15.516898 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-68bbadb4-f257-4f3f-ae44-e9bbb184604c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:15.517333 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-68bbadb4-f257-4f3f-ae44-e9bbb184604c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:15.518021 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-68bbadb4-f257-4f3f-ae44-e9bbb184604c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:15.518472 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-68bbadb4-f257-4f3f-ae44-e9bbb184604c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:15.518899 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-68bbadb4-f257-4f3f-ae44-e9bbb184604c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:15.766316 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-68bbadb4-f257-4f3f-ae44-e9bbb184604c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:15.774507 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-68bbadb4-f257-4f3f-ae44-e9bbb184604c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.268275 Aug 31 00:40:15.775733 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 323/655] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:15 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:16.301662 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0b170c96-a9fe-4202-8410-1637aa5f3f5f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:16.302435 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-0b170c96-a9fe-4202-8410-1637aa5f3f5f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:16.309598 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0b170c96-a9fe-4202-8410-1637aa5f3f5f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:16.310088 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0b170c96-a9fe-4202-8410-1637aa5f3f5f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:16.310550 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0b170c96-a9fe-4202-8410-1637aa5f3f5f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:16.311260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0b170c96-a9fe-4202-8410-1637aa5f3f5f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:16.311713 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0b170c96-a9fe-4202-8410-1637aa5f3f5f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:16.312137 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0b170c96-a9fe-4202-8410-1637aa5f3f5f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:16.378370 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a295337f-8553-4ef3-94c3-c0411317323e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:16.378975 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-a295337f-8553-4ef3-94c3-c0411317323e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:16.387718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a295337f-8553-4ef3-94c3-c0411317323e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:16.388211 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a295337f-8553-4ef3-94c3-c0411317323e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:16.388671 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a295337f-8553-4ef3-94c3-c0411317323e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:16.389378 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a295337f-8553-4ef3-94c3-c0411317323e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:16.390002 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a295337f-8553-4ef3-94c3-c0411317323e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:16.390256 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a295337f-8553-4ef3-94c3-c0411317323e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:16.576683 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-0b170c96-a9fe-4202-8410-1637aa5f3f5f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:16.584756 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-0b170c96-a9fe-4202-8410-1637aa5f3f5f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1267 microversion: 2.1 time: 0.287406 Aug 31 00:40:16.585988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 333/656] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:16 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1267 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:16.591285 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-7e48ad86-7f65-461a-895a-a795b5715eb9 req-cea9ecfa-69ae-4b80-ab33-a86ced7e5c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71a61bc-1bd8-4191-96c6-7f7e2e4db485", "name": "network-vif-deleted", "tag": "ba4bd26f-64e9-4863-a592-ab685b279ebe"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:16.600960 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-7e48ad86-7f65-461a-895a-a795b5715eb9 req-cea9ecfa-69ae-4b80-ab33-a86ced7e5c37 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:16.601447 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-7e48ad86-7f65-461a-895a-a795b5715eb9 req-cea9ecfa-69ae-4b80-ab33-a86ced7e5c37 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:16.601873 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-7e48ad86-7f65-461a-895a-a795b5715eb9 req-cea9ecfa-69ae-4b80-ab33-a86ced7e5c37 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:16.606213 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-a295337f-8553-4ef3-94c3-c0411317323e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:16.614136 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a295337f-8553-4ef3-94c3-c0411317323e tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1479 microversion: 2.1 time: 0.239687 Aug 31 00:40:16.614900 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-7e48ad86-7f65-461a-895a-a795b5715eb9 req-cea9ecfa-69ae-4b80-ab33-a86ced7e5c37 service nova] Creating event network-vif-deleted:ba4bd26f-64e9-4863-a592-ab685b279ebe for instance e71a61bc-1bd8-4191-96c6-7f7e2e4db485 on hv-cinder-85221 Aug 31 00:40:16.620872 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-7e48ad86-7f65-461a-895a-a795b5715eb9 req-cea9ecfa-69ae-4b80-ab33-a86ced7e5c37 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033512 Aug 31 00:40:16.621480 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 334/657] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:16.621975 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 324/658] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:16 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1479 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:16.797415 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-189656da-5251-49e4-b7e1-16f04d32884c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:16.798110 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-189656da-5251-49e4-b7e1-16f04d32884c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:16.805414 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-189656da-5251-49e4-b7e1-16f04d32884c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:16.806600 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-189656da-5251-49e4-b7e1-16f04d32884c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:16.807100 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-189656da-5251-49e4-b7e1-16f04d32884c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:16.807794 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-189656da-5251-49e4-b7e1-16f04d32884c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:16.808240 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-189656da-5251-49e4-b7e1-16f04d32884c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:16.808689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-189656da-5251-49e4-b7e1-16f04d32884c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:16.956828 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-189656da-5251-49e4-b7e1-16f04d32884c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:16.965337 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-189656da-5251-49e4-b7e1-16f04d32884c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.172062 Aug 31 00:40:16.966055 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 335/659] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:16 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:17.608566 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-13b40159-5876-4f8e-93ad-3cd27e8424da tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:17.617231 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-13b40159-5876-4f8e-93ad-3cd27e8424da tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:17.624569 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-13b40159-5876-4f8e-93ad-3cd27e8424da tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:17.625143 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-13b40159-5876-4f8e-93ad-3cd27e8424da tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:17.625571 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-13b40159-5876-4f8e-93ad-3cd27e8424da tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:17.626267 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-13b40159-5876-4f8e-93ad-3cd27e8424da tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:17.626761 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-13b40159-5876-4f8e-93ad-3cd27e8424da tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:17.627222 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-13b40159-5876-4f8e-93ad-3cd27e8424da tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:17.638580 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-7aea9990-0929-4365-98d2-edaf8b9e5ad7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:17.639175 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-7aea9990-0929-4365-98d2-edaf8b9e5ad7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:17.641189 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:17.645965 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7aea9990-0929-4365-98d2-edaf8b9e5ad7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:17.646448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7aea9990-0929-4365-98d2-edaf8b9e5ad7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:17.646882 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7aea9990-0929-4365-98d2-edaf8b9e5ad7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:17.647626 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7aea9990-0929-4365-98d2-edaf8b9e5ad7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:17.648079 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7aea9990-0929-4365-98d2-edaf8b9e5ad7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:17.648531 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7aea9990-0929-4365-98d2-edaf8b9e5ad7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:17.715083 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7aea9990-0929-4365-98d2-edaf8b9e5ad7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:17.723026 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-7aea9990-0929-4365-98d2-edaf8b9e5ad7 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1307 microversion: 2.1 time: 0.089410 Aug 31 00:40:17.725482 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 336/660] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:17 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1307 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:17.766330 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-13b40159-5876-4f8e-93ad-3cd27e8424da tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:17.774481 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-13b40159-5876-4f8e-93ad-3cd27e8424da tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1267 microversion: 2.1 time: 0.171171 Aug 31 00:40:17.775790 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 325/661] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:17 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:17.987683 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6e49ef18-474b-46c9-8c98-0abf610ca949 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:17.988204 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6e49ef18-474b-46c9-8c98-0abf610ca949 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:17.994876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6e49ef18-474b-46c9-8c98-0abf610ca949 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:17.995360 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6e49ef18-474b-46c9-8c98-0abf610ca949 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:17.995821 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6e49ef18-474b-46c9-8c98-0abf610ca949 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:17.996553 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6e49ef18-474b-46c9-8c98-0abf610ca949 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:17.997015 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6e49ef18-474b-46c9-8c98-0abf610ca949 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:17.997437 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6e49ef18-474b-46c9-8c98-0abf610ca949 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:18.136465 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6e49ef18-474b-46c9-8c98-0abf610ca949 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:18.144167 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6e49ef18-474b-46c9-8c98-0abf610ca949 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.160926 Aug 31 00:40:18.144778 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 337/662] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:17 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:18.745452 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-55eaf8b3-c4cc-4d9e-b430-56e74fc96375 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:18.746065 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-55eaf8b3-c4cc-4d9e-b430-56e74fc96375 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:18.752595 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-55eaf8b3-c4cc-4d9e-b430-56e74fc96375 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:18.753079 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-55eaf8b3-c4cc-4d9e-b430-56e74fc96375 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:18.753514 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-55eaf8b3-c4cc-4d9e-b430-56e74fc96375 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:18.754229 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-55eaf8b3-c4cc-4d9e-b430-56e74fc96375 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:18.754708 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-55eaf8b3-c4cc-4d9e-b430-56e74fc96375 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:18.755166 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-55eaf8b3-c4cc-4d9e-b430-56e74fc96375 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:18.770231 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:18.787333 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-55eaf8b3-c4cc-4d9e-b430-56e74fc96375 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:18.787809 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-55eaf8b3-c4cc-4d9e-b430-56e74fc96375 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:18.788241 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-55eaf8b3-c4cc-4d9e-b430-56e74fc96375 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:18.788703 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-55eaf8b3-c4cc-4d9e-b430-56e74fc96375 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lazy-loading 'fault' on Instance uuid e71a61bc-1bd8-4191-96c6-7f7e2e4db485 {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:40:18.796448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-7141162d-90e0-431f-97dd-685575b373a1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:18.797078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-7141162d-90e0-431f-97dd-685575b373a1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:18.803957 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7141162d-90e0-431f-97dd-685575b373a1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:18.804486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7141162d-90e0-431f-97dd-685575b373a1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:18.804925 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7141162d-90e0-431f-97dd-685575b373a1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:18.805641 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7141162d-90e0-431f-97dd-685575b373a1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:18.806104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7141162d-90e0-431f-97dd-685575b373a1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:18.806530 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7141162d-90e0-431f-97dd-685575b373a1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:18.831532 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-55eaf8b3-c4cc-4d9e-b430-56e74fc96375 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:18.840019 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-55eaf8b3-c4cc-4d9e-b430-56e74fc96375 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1312 microversion: 2.1 time: 0.099068 Aug 31 00:40:18.840622 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 326/663] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:18 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:18.945583 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7141162d-90e0-431f-97dd-685575b373a1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:18.953609 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-7141162d-90e0-431f-97dd-685575b373a1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1454 microversion: 2.1 time: 0.161804 Aug 31 00:40:18.954169 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 338/664] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:18 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:18.974602 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-800f08f3-444c-4d82-aae6-e206308c0b96 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:18.975311 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-800f08f3-444c-4d82-aae6-e206308c0b96 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:18.982042 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-800f08f3-444c-4d82-aae6-e206308c0b96 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:18.982510 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-800f08f3-444c-4d82-aae6-e206308c0b96 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:18.982933 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-800f08f3-444c-4d82-aae6-e206308c0b96 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:18.983648 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-800f08f3-444c-4d82-aae6-e206308c0b96 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:18.984182 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-800f08f3-444c-4d82-aae6-e206308c0b96 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:18.984624 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-800f08f3-444c-4d82-aae6-e206308c0b96 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:19.122852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-800f08f3-444c-4d82-aae6-e206308c0b96 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:19.130676 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-800f08f3-444c-4d82-aae6-e206308c0b96 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1454 microversion: 2.1 time: 0.160671 Aug 31 00:40:19.131231 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 327/665] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:18 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:19.167469 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-fd9152ae-1240-4be4-8883-e4cccbbbe1c4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:19.168737 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-fd9152ae-1240-4be4-8883-e4cccbbbe1c4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:19.175251 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fd9152ae-1240-4be4-8883-e4cccbbbe1c4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:19.175251 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fd9152ae-1240-4be4-8883-e4cccbbbe1c4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:19.175599 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fd9152ae-1240-4be4-8883-e4cccbbbe1c4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:19.176264 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fd9152ae-1240-4be4-8883-e4cccbbbe1c4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:19.176737 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fd9152ae-1240-4be4-8883-e4cccbbbe1c4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:19.177151 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fd9152ae-1240-4be4-8883-e4cccbbbe1c4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:19.357649 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-fd9152ae-1240-4be4-8883-e4cccbbbe1c4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:19.365504 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-fd9152ae-1240-4be4-8883-e4cccbbbe1c4 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.202986 Aug 31 00:40:19.366072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 339/666] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:19 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:19.863583 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9f27ac3d-88ea-4350-8274-548caffe6b87 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:19.863583 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9f27ac3d-88ea-4350-8274-548caffe6b87 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:19.869474 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f27ac3d-88ea-4350-8274-548caffe6b87 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:19.871578 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f27ac3d-88ea-4350-8274-548caffe6b87 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:19.872231 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f27ac3d-88ea-4350-8274-548caffe6b87 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:19.873133 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f27ac3d-88ea-4350-8274-548caffe6b87 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:19.873755 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f27ac3d-88ea-4350-8274-548caffe6b87 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:19.874174 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f27ac3d-88ea-4350-8274-548caffe6b87 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:19.911975 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f27ac3d-88ea-4350-8274-548caffe6b87 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:19.912895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f27ac3d-88ea-4350-8274-548caffe6b87 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:19.913485 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f27ac3d-88ea-4350-8274-548caffe6b87 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:19.914923 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-9f27ac3d-88ea-4350-8274-548caffe6b87 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lazy-loading 'fault' on Instance uuid e71a61bc-1bd8-4191-96c6-7f7e2e4db485 {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:40:19.961581 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-9f27ac3d-88ea-4350-8274-548caffe6b87 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d23c99308c414f939761b07d329e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8aa6e0e8e6b492f8e74eea0e830c0bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:19.970067 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9f27ac3d-88ea-4350-8274-548caffe6b87 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 200 len: 1312 microversion: 2.1 time: 0.113313 Aug 31 00:40:19.970646 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 328/667] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:19 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 1312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:20.324919 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3419cf50-69a8-40fa-b7ab-bebf692aafc7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ee5c2f3-3730-4e11-b9a1-e79eda07da99"}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:20.327524 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-3419cf50-69a8-40fa-b7ab-bebf692aafc7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:20.334127 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3419cf50-69a8-40fa-b7ab-bebf692aafc7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:20.334635 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3419cf50-69a8-40fa-b7ab-bebf692aafc7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:20.335204 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3419cf50-69a8-40fa-b7ab-bebf692aafc7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:20.335800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3419cf50-69a8-40fa-b7ab-bebf692aafc7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:20.336255 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3419cf50-69a8-40fa-b7ab-bebf692aafc7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:20.336711 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3419cf50-69a8-40fa-b7ab-bebf692aafc7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:20.389822 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-fc4a0603-ab02-4cd1-ac21-722a579506dc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:20.390853 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-fc4a0603-ab02-4cd1-ac21-722a579506dc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:20.397439 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fc4a0603-ab02-4cd1-ac21-722a579506dc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:20.399125 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fc4a0603-ab02-4cd1-ac21-722a579506dc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:20.399125 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fc4a0603-ab02-4cd1-ac21-722a579506dc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:20.399566 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fc4a0603-ab02-4cd1-ac21-722a579506dc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:20.399884 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fc4a0603-ab02-4cd1-ac21-722a579506dc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:20.400301 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fc4a0603-ab02-4cd1-ac21-722a579506dc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:20.423347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-3419cf50-69a8-40fa-b7ab-bebf692aafc7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] HTTP exception thrown: Invalid volume: volume 1ee5c2f3-3730-4e11-b9a1-e79eda07da99 is already attached to instances: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3419cf50-69a8-40fa-b7ab-bebf692aafc7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Request method failure captured: Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: POST /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd/os-volume_attachments HTTP/1.1 Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 74 Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqy7MJOpqb7URH2NMlvnlry7FN8PMqekPyTr4WdpuFP-EJ4P09V7u5pIkcg9D2y64tDq06EhUYjkLoVEA5Xo6OkeLUr7BvIjtmrEoq-poVSUiJYXz83e0U_QXEU4_Gc_m-Y7QkotdhwKhL3RvXqk7a5HcYY_0K_fB-YMAW3D8wMuR_c Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:40:20.425714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:40:20.431842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:40:20.431842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:40:20.431842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:40:20.431842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:40:20.431842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:40:20.431842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:40:20.431842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:40:20.431842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 45422a67a78f4784abc0f18ad84778f3 Aug 31 00:40:20.431842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:40:20.431842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Aug 31 00:40:20.431842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {"volumeAttachment": {"volumeId": "1ee5c2f3-3730-4e11-b9a1-e79eda07da99"}} Aug 31 00:40:20.431842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:40:20.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Invalid volume: volume 1ee5c2f3-3730-4e11-b9a1-e79eda07da99 is already attached to instances: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd Aug 31 00:40:20.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'server_id': '24bd8f41-5ce3-4260-bd3e-d98a55817bfd', 'body': {'volumeAttachment': {'volumeId': '1ee5c2f3-3730-4e11-b9a1-e79eda07da99'}}} Aug 31 00:40:20.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:40:20.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:40:20.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 00:40:20.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 00:40:20.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 00:40:20.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 00:40:20.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 00:40:20.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 00:40:20.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 00:40:20.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 00:40:20.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 00:40:20.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 00:40:20.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1ee5c2f3-3730-4e11-b9a1-e79eda07da99 is already attached to instances: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd Aug 31 00:40:20.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:20.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:40:20.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:20.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1ee5c2f3-3730-4e11-b9a1-e79eda07da99 is already attached to instances: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:40:20.434413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:40:20.435645 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:40:20.435645 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:40:20.435645 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:40:20.435645 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1ee5c2f3-3730-4e11-b9a1-e79eda07da99 is already attached to instances: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd Aug 31 00:40:20.435645 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:20.435645 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3419cf50-69a8-40fa-b7ab-bebf692aafc7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Returning 400 to user: Invalid volume: volume 1ee5c2f3-3730-4e11-b9a1-e79eda07da99 is already attached to instances: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:40:20.435645 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-3419cf50-69a8-40fa-b7ab-bebf692aafc7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "POST /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107316 Aug 31 00:40:20.435645 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 340/668] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 00:40:20 2022] POST /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:40:20.515170 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d8eba80a-cd70-4b83-94c1-51df5d1a39c8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:20.515920 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d8eba80a-cd70-4b83-94c1-51df5d1a39c8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:20.522004 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8eba80a-cd70-4b83-94c1-51df5d1a39c8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:20.522582 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8eba80a-cd70-4b83-94c1-51df5d1a39c8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:20.523086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8eba80a-cd70-4b83-94c1-51df5d1a39c8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:20.523888 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8eba80a-cd70-4b83-94c1-51df5d1a39c8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:20.524689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8eba80a-cd70-4b83-94c1-51df5d1a39c8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:20.525182 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8eba80a-cd70-4b83-94c1-51df5d1a39c8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:20.584920 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fc4a0603-ab02-4cd1-ac21-722a579506dc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:20.593239 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-fc4a0603-ab02-4cd1-ac21-722a579506dc tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.208242 Aug 31 00:40:20.593816 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 329/669] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:20 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:20.611324 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-d8eba80a-cd70-4b83-94c1-51df5d1a39c8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lazy-loading 'services' on Instance uuid 24bd8f41-5ce3-4260-bd3e-d98a55817bfd {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:40:20.774864 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=100 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:20.902249 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d8eba80a-cd70-4b83-94c1-51df5d1a39c8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "DELETE /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd/os-volume_attachments/1ee5c2f3-3730-4e11-b9a1-e79eda07da99" status: 202 len: 0 microversion: 2.1 time: 0.390825 Aug 31 00:40:20.903198 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 341/670] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 00:40:20 2022] DELETE /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd/os-volume_attachments/1ee5c2f3-3730-4e11-b9a1-e79eda07da99 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:40:20.918708 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-06e27e1d-b0f2-441d-a864-fdaccb2eba19 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:20.920967 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-06e27e1d-b0f2-441d-a864-fdaccb2eba19 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:20.927450 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-06e27e1d-b0f2-441d-a864-fdaccb2eba19 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:20.927920 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-06e27e1d-b0f2-441d-a864-fdaccb2eba19 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:20.928372 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-06e27e1d-b0f2-441d-a864-fdaccb2eba19 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:20.929080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-06e27e1d-b0f2-441d-a864-fdaccb2eba19 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:20.929526 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-06e27e1d-b0f2-441d-a864-fdaccb2eba19 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:20.929939 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-06e27e1d-b0f2-441d-a864-fdaccb2eba19 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:20.961668 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-06e27e1d-b0f2-441d-a864-fdaccb2eba19 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047006 Aug 31 00:40:20.962431 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 330/671] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:20 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:20.992022 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-852d64e6-83bb-4d44-ac9e-2123c1481a40 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:20.992739 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-852d64e6-83bb-4d44-ac9e-2123c1481a40 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] [instance: e71a61bc-1bd8-4191-96c6-7f7e2e4db485] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:20.999037 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-852d64e6-83bb-4d44-ac9e-2123c1481a40 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:20.999517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-852d64e6-83bb-4d44-ac9e-2123c1481a40 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:20.999942 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-852d64e6-83bb-4d44-ac9e-2123c1481a40 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:21.000654 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-852d64e6-83bb-4d44-ac9e-2123c1481a40 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:21.001099 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-852d64e6-83bb-4d44-ac9e-2123c1481a40 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:21.001560 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-852d64e6-83bb-4d44-ac9e-2123c1481a40 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:21.018358 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-852d64e6-83bb-4d44-ac9e-2123c1481a40 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] HTTP exception thrown: Instance e71a61bc-1bd8-4191-96c6-7f7e2e4db485 could not be found. Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-852d64e6-83bb-4d44-ac9e-2123c1481a40 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Request method failure captured: Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 HTTP/1.1 Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqyzEg2Mk_Qrf-4ucl5mTksNAq4yJwZyFBzvEgaG-5wDv2_jHH3xLzlf6obMgJH9KOGrXwUBwxa_Key6OaUOrEfJ-OUrg1I_ZHusiecer0qLWJfeK6Wzpvtw2fZKiIczmma4oKpwrpEcygSzKn_2orgSwt38-qdaeq_LONkjXnfIEKU Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: d8aa6e0e8e6b492f8e74eea0e830c0bc Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1041420977 Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:40:21.020305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:40:21.022297 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d8aa6e0e8e6b492f8e74eea0e830c0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:40:21.022297 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1041420977 Aug 31 00:40:21.022297 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: d8aa6e0e8e6b492f8e74eea0e830c0bc Aug 31 00:40:21.022297 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1041420977 Aug 31 00:40:21.022297 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-ServerRescueNegativeTestJSON-1041420977-project Aug 31 00:40:21.022297 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:40:21.022297 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:40:21.022297 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 77d23c99308c414f939761b07d329e03 Aug 31 00:40:21.022297 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1041420977-project Aug 31 00:40:21.022297 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:40:21.022297 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance e71a61bc-1bd8-4191-96c6-7f7e2e4db485 could not be found. Aug 31 00:40:21.022297 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': 'e71a61bc-1bd8-4191-96c6-7f7e2e4db485'} Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e71a61bc-1bd8-4191-96c6-7f7e2e4db485 could not be found. Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:40:21.023023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:40:21.024463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:40:21.024463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:40:21.024463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:40:21.024463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:40:21.024463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:40:21.024463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:40:21.024463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:40:21.024463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e71a61bc-1bd8-4191-96c6-7f7e2e4db485 could not be found. Aug 31 00:40:21.024463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:21.024463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:40:21.024463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:21.024463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:40:21.024463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:40:21.024463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:40:21.024463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:40:21.024463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:40:21.024463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e71a61bc-1bd8-4191-96c6-7f7e2e4db485 could not be found. Aug 31 00:40:21.024463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:21.025807 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-852d64e6-83bb-4d44-ac9e-2123c1481a40 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] Returning 404 to user: Instance e71a61bc-1bd8-4191-96c6-7f7e2e4db485 could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:40:21.025807 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-852d64e6-83bb-4d44-ac9e-2123c1481a40 tempest-ServerRescueNegativeTestJSON-1041420977 tempest-ServerRescueNegativeTestJSON-1041420977-project] 10.222.0.65 "GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485" status: 404 len: 111 microversion: 2.1 time: 0.034307 Aug 31 00:40:21.025807 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 342/672] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:20 2022] GET /compute/v2.1/servers/e71a61bc-1bd8-4191-96c6-7f7e2e4db485 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:40:21.407100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-6c020b9d-3557-4a9f-a658-777860b6bc5b req-8a7aced5-5b84-4357-9d68-16d5f291b480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747", "tag": "d40a5de5-de00-4fca-9d0f-1539d5f4fc04"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:21.420131 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-6c020b9d-3557-4a9f-a658-777860b6bc5b req-8a7aced5-5b84-4357-9d68-16d5f291b480 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:21.420990 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-6c020b9d-3557-4a9f-a658-777860b6bc5b req-8a7aced5-5b84-4357-9d68-16d5f291b480 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:21.421637 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-6c020b9d-3557-4a9f-a658-777860b6bc5b req-8a7aced5-5b84-4357-9d68-16d5f291b480 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:21.435155 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-6c020b9d-3557-4a9f-a658-777860b6bc5b req-8a7aced5-5b84-4357-9d68-16d5f291b480 service nova] Creating event network-changed:d40a5de5-de00-4fca-9d0f-1539d5f4fc04 for instance 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 on hv-cinder-85221 Aug 31 00:40:21.440147 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-6c020b9d-3557-4a9f-a658-777860b6bc5b req-8a7aced5-5b84-4357-9d68-16d5f291b480 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036701 Aug 31 00:40:21.440806 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 331/673] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:21.616687 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-813b4230-a7b0-4699-830b-8f100a2a77f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:21.618068 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-813b4230-a7b0-4699-830b-8f100a2a77f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:21.625602 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-813b4230-a7b0-4699-830b-8f100a2a77f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:21.626716 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-813b4230-a7b0-4699-830b-8f100a2a77f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:21.627530 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-813b4230-a7b0-4699-830b-8f100a2a77f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:21.628427 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-813b4230-a7b0-4699-830b-8f100a2a77f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:21.629034 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-813b4230-a7b0-4699-830b-8f100a2a77f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:21.629610 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-813b4230-a7b0-4699-830b-8f100a2a77f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:21.845803 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-813b4230-a7b0-4699-830b-8f100a2a77f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:21.855548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-813b4230-a7b0-4699-830b-8f100a2a77f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1568 microversion: 2.1 time: 0.244396 Aug 31 00:40:21.868926 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 343/674] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:21 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:21.877676 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-5024682d-0158-41a5-9e80-d42c0e9bcdc3 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:21.878795 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-5024682d-0158-41a5-9e80-d42c0e9bcdc3 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:21.887100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5024682d-0158-41a5-9e80-d42c0e9bcdc3 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:21.888044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5024682d-0158-41a5-9e80-d42c0e9bcdc3 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:21.888671 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5024682d-0158-41a5-9e80-d42c0e9bcdc3 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:21.889595 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5024682d-0158-41a5-9e80-d42c0e9bcdc3 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:21.890233 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5024682d-0158-41a5-9e80-d42c0e9bcdc3 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:21.890815 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5024682d-0158-41a5-9e80-d42c0e9bcdc3 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:21.926536 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-5024682d-0158-41a5-9e80-d42c0e9bcdc3 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128048) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 00:40:21.975550 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3d74d5fb-8757-4a01-8145-dfe86be88d78 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:21.977963 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-3d74d5fb-8757-4a01-8145-dfe86be88d78 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:21.986230 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3d74d5fb-8757-4a01-8145-dfe86be88d78 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:21.986803 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3d74d5fb-8757-4a01-8145-dfe86be88d78 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:21.987304 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3d74d5fb-8757-4a01-8145-dfe86be88d78 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:21.988069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3d74d5fb-8757-4a01-8145-dfe86be88d78 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:21.988788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3d74d5fb-8757-4a01-8145-dfe86be88d78 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:21.989304 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3d74d5fb-8757-4a01-8145-dfe86be88d78 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:22.024022 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-3d74d5fb-8757-4a01-8145-dfe86be88d78 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052784 Aug 31 00:40:22.025441 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 344/675] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:21 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:22.243865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-5024682d-0158-41a5-9e80-d42c0e9bcdc3 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "POST /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3/action" status: 202 len: 0 microversion: 2.1 time: 0.367182 Aug 31 00:40:22.244038 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 332/676] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 00:40:21 2022] POST /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:40:22.250102 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-374d0fd7-d828-4e33-ad9a-fd026dea8b93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:22.250711 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-374d0fd7-d828-4e33-ad9a-fd026dea8b93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:22.259702 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-374d0fd7-d828-4e33-ad9a-fd026dea8b93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:22.260282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-374d0fd7-d828-4e33-ad9a-fd026dea8b93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:22.261012 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-374d0fd7-d828-4e33-ad9a-fd026dea8b93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:22.261818 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-374d0fd7-d828-4e33-ad9a-fd026dea8b93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:22.262333 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-374d0fd7-d828-4e33-ad9a-fd026dea8b93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:22.263007 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-374d0fd7-d828-4e33-ad9a-fd026dea8b93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:22.457186 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-374d0fd7-d828-4e33-ad9a-fd026dea8b93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:22.468604 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-374d0fd7-d828-4e33-ad9a-fd026dea8b93 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1576 microversion: 2.1 time: 0.221397 Aug 31 00:40:22.469477 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 345/677] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:22 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1576 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:22.856502 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-0c570f4c-f1c0-4238-b246-1eab2a7f1b1e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:22.858714 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-0c570f4c-f1c0-4238-b246-1eab2a7f1b1e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:22.871748 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0c570f4c-f1c0-4238-b246-1eab2a7f1b1e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:22.871748 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0c570f4c-f1c0-4238-b246-1eab2a7f1b1e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:22.871748 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0c570f4c-f1c0-4238-b246-1eab2a7f1b1e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:22.871748 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0c570f4c-f1c0-4238-b246-1eab2a7f1b1e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:22.872248 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0c570f4c-f1c0-4238-b246-1eab2a7f1b1e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:22.872248 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0c570f4c-f1c0-4238-b246-1eab2a7f1b1e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:22.919743 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-0c570f4c-f1c0-4238-b246-1eab2a7f1b1e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077376 Aug 31 00:40:22.926172 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 333/678] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:22 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:40:22.986388 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d1cfaccf-33d1-4163-b940-0c73bf6ffe15 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:22.986969 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d1cfaccf-33d1-4163-b940-0c73bf6ffe15 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:22.993768 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d1cfaccf-33d1-4163-b940-0c73bf6ffe15 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:22.994325 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d1cfaccf-33d1-4163-b940-0c73bf6ffe15 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:22.995425 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d1cfaccf-33d1-4163-b940-0c73bf6ffe15 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:22.996125 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d1cfaccf-33d1-4163-b940-0c73bf6ffe15 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:22.996612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d1cfaccf-33d1-4163-b940-0c73bf6ffe15 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:22.997030 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d1cfaccf-33d1-4163-b940-0c73bf6ffe15 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:23.024027 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d1cfaccf-33d1-4163-b940-0c73bf6ffe15 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Going to try to terminate instance {{(pid=128049) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:40:23.038275 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9db6ca1d-b95e-4dcb-a432-2c83bd6c3b82 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:23.040145 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9db6ca1d-b95e-4dcb-a432-2c83bd6c3b82 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:23.047723 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9db6ca1d-b95e-4dcb-a432-2c83bd6c3b82 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:23.048200 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9db6ca1d-b95e-4dcb-a432-2c83bd6c3b82 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:23.048869 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9db6ca1d-b95e-4dcb-a432-2c83bd6c3b82 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:23.056292 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9db6ca1d-b95e-4dcb-a432-2c83bd6c3b82 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:23.056292 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9db6ca1d-b95e-4dcb-a432-2c83bd6c3b82 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:23.056292 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9db6ca1d-b95e-4dcb-a432-2c83bd6c3b82 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:23.083460 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9db6ca1d-b95e-4dcb-a432-2c83bd6c3b82 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049459 Aug 31 00:40:23.084137 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 334/679] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:40:23 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 00:40:23.155642 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-76f2669c-6fb9-4ca2-9345-ba91acf029ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:23.155864 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-76f2669c-6fb9-4ca2-9345-ba91acf029ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:23.161592 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-76f2669c-6fb9-4ca2-9345-ba91acf029ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:23.162076 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-76f2669c-6fb9-4ca2-9345-ba91acf029ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:23.162515 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-76f2669c-6fb9-4ca2-9345-ba91acf029ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:23.163206 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-76f2669c-6fb9-4ca2-9345-ba91acf029ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:23.163656 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-76f2669c-6fb9-4ca2-9345-ba91acf029ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:23.164078 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-76f2669c-6fb9-4ca2-9345-ba91acf029ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:23.191367 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-76f2669c-6fb9-4ca2-9345-ba91acf029ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Going to try to terminate instance {{(pid=128048) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:40:23.518633 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d1cfaccf-33d1-4163-b940-0c73bf6ffe15 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "DELETE /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 204 len: 0 microversion: 2.1 time: 0.535878 Aug 31 00:40:23.519397 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 346/680] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:40:22 2022] DELETE /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:40:23.525235 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f7dc1115-186f-47a7-82f1-f227dc8446ee tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:23.526858 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f7dc1115-186f-47a7-82f1-f227dc8446ee tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:23.533193 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f7dc1115-186f-47a7-82f1-f227dc8446ee tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:23.533681 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f7dc1115-186f-47a7-82f1-f227dc8446ee tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:23.534185 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f7dc1115-186f-47a7-82f1-f227dc8446ee tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:23.535152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f7dc1115-186f-47a7-82f1-f227dc8446ee tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:23.535611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f7dc1115-186f-47a7-82f1-f227dc8446ee tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:23.536037 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f7dc1115-186f-47a7-82f1-f227dc8446ee tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:23.655770 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-76f2669c-6fb9-4ca2-9345-ba91acf029ac tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "DELETE /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 204 len: 0 microversion: 2.1 time: 0.504578 Aug 31 00:40:23.656397 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 335/681] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:40:23 2022] DELETE /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:40:23.662435 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-5d8b845d-5717-4c8a-9643-0144c52fc314 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:23.663456 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-5d8b845d-5717-4c8a-9643-0144c52fc314 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:23.672227 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5d8b845d-5717-4c8a-9643-0144c52fc314 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:23.673666 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5d8b845d-5717-4c8a-9643-0144c52fc314 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:23.674310 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5d8b845d-5717-4c8a-9643-0144c52fc314 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:23.675304 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5d8b845d-5717-4c8a-9643-0144c52fc314 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:23.676019 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5d8b845d-5717-4c8a-9643-0144c52fc314 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:23.676716 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5d8b845d-5717-4c8a-9643-0144c52fc314 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:23.712277 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f7dc1115-186f-47a7-82f1-f227dc8446ee tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:23.721576 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f7dc1115-186f-47a7-82f1-f227dc8446ee tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1516 microversion: 2.1 time: 0.201154 Aug 31 00:40:23.722765 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 347/682] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:23 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1516 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:23.727908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-28106bd6-76c7-4437-8a4e-9c779a52017a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:23.729928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-28106bd6-76c7-4437-8a4e-9c779a52017a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:23.736234 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-28106bd6-76c7-4437-8a4e-9c779a52017a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:23.737020 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-28106bd6-76c7-4437-8a4e-9c779a52017a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:23.737687 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-28106bd6-76c7-4437-8a4e-9c779a52017a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:23.738736 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-28106bd6-76c7-4437-8a4e-9c779a52017a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:23.739558 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-28106bd6-76c7-4437-8a4e-9c779a52017a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:23.740168 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-28106bd6-76c7-4437-8a4e-9c779a52017a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:23.887571 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-28106bd6-76c7-4437-8a4e-9c779a52017a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:23.895855 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-28106bd6-76c7-4437-8a4e-9c779a52017a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1682 microversion: 2.1 time: 0.171659 Aug 31 00:40:23.896469 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 348/683] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:23 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:23.931988 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-5d8b845d-5717-4c8a-9643-0144c52fc314 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:23.940317 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-5d8b845d-5717-4c8a-9643-0144c52fc314 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1670 microversion: 2.1 time: 0.282408 Aug 31 00:40:23.940950 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 336/684] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:23 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1670 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:24.036864 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-9dd0522e-6894-41fa-aeda-6e7e3593dcad req-f7be70d0-28bc-472b-b6af-567aec0f240a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce65669-d807-40a9-95e1-8cb85a0f03c3", "name": "network-vif-unplugged", "status": "completed", "tag": "c18f4b3c-fb43-40d2-901a-6255ea8c3f61"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:24.047428 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-9dd0522e-6894-41fa-aeda-6e7e3593dcad req-f7be70d0-28bc-472b-b6af-567aec0f240a service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:24.047929 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-9dd0522e-6894-41fa-aeda-6e7e3593dcad req-f7be70d0-28bc-472b-b6af-567aec0f240a service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:24.048407 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-9dd0522e-6894-41fa-aeda-6e7e3593dcad req-f7be70d0-28bc-472b-b6af-567aec0f240a service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:24.061619 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.compute.server_external_events [req-9dd0522e-6894-41fa-aeda-6e7e3593dcad req-f7be70d0-28bc-472b-b6af-567aec0f240a service nova] Unable to find a host for instance bce65669-d807-40a9-95e1-8cb85a0f03c3. Dropping event network-vif-unplugged {{(pid=128049) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 00:40:24.062491 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-9dd0522e-6894-41fa-aeda-6e7e3593dcad req-f7be70d0-28bc-472b-b6af-567aec0f240a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029563 Aug 31 00:40:24.063079 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 349/685] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 31 00:40:24.693957 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-01af8323-34ea-4df6-9e14-ba12c06f0010 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:24.694478 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-01af8323-34ea-4df6-9e14-ba12c06f0010 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:24.702023 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-01af8323-34ea-4df6-9e14-ba12c06f0010 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:24.702520 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-01af8323-34ea-4df6-9e14-ba12c06f0010 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:24.702951 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-01af8323-34ea-4df6-9e14-ba12c06f0010 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:24.703655 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-01af8323-34ea-4df6-9e14-ba12c06f0010 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:24.704107 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-01af8323-34ea-4df6-9e14-ba12c06f0010 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:24.704575 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-01af8323-34ea-4df6-9e14-ba12c06f0010 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:24.730252 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-01af8323-34ea-4df6-9e14-ba12c06f0010 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa/ips" status: 200 len: 153 microversion: 2.20 time: 0.107975 Aug 31 00:40:24.731108 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 337/686] 10.222.0.65 () {60 vars in 1289 bytes} [Wed Aug 31 00:40:24 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa/ips => generated 153 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:40:24.743274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8d395bbc-4685-47df-9476-b640dcc5bc27 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:24.743882 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8d395bbc-4685-47df-9476-b640dcc5bc27 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:24.751034 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8d395bbc-4685-47df-9476-b640dcc5bc27 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:24.751522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8d395bbc-4685-47df-9476-b640dcc5bc27 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:24.751959 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8d395bbc-4685-47df-9476-b640dcc5bc27 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:24.752697 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8d395bbc-4685-47df-9476-b640dcc5bc27 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:24.753147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8d395bbc-4685-47df-9476-b640dcc5bc27 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:24.753750 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8d395bbc-4685-47df-9476-b640dcc5bc27 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:24.918561 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-1b9420f6-f75b-4567-97d0-0847ce4b2b42 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:24.919170 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-1b9420f6-f75b-4567-97d0-0847ce4b2b42 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:24.926358 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1b9420f6-f75b-4567-97d0-0847ce4b2b42 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:24.926849 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1b9420f6-f75b-4567-97d0-0847ce4b2b42 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:24.927357 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1b9420f6-f75b-4567-97d0-0847ce4b2b42 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:24.927990 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1b9420f6-f75b-4567-97d0-0847ce4b2b42 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:24.928493 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1b9420f6-f75b-4567-97d0-0847ce4b2b42 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:24.928958 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1b9420f6-f75b-4567-97d0-0847ce4b2b42 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:24.974529 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8d395bbc-4685-47df-9476-b640dcc5bc27 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:24.997470 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8d395bbc-4685-47df-9476-b640dcc5bc27 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1516 microversion: 2.1 time: 0.257902 Aug 31 00:40:25.004374 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 350/687] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:24 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1516 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:25.006076 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c1d7eb1d-6798-4be3-b932-ce28593b8dc9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:25.006733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c1d7eb1d-6798-4be3-b932-ce28593b8dc9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:25.013881 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c1d7eb1d-6798-4be3-b932-ce28593b8dc9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:25.014363 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c1d7eb1d-6798-4be3-b932-ce28593b8dc9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:25.014799 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c1d7eb1d-6798-4be3-b932-ce28593b8dc9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:25.015512 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c1d7eb1d-6798-4be3-b932-ce28593b8dc9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:25.015966 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c1d7eb1d-6798-4be3-b932-ce28593b8dc9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:25.016427 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c1d7eb1d-6798-4be3-b932-ce28593b8dc9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:25.092744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-1b9420f6-f75b-4567-97d0-0847ce4b2b42 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:25.100563 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-1b9420f6-f75b-4567-97d0-0847ce4b2b42 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1682 microversion: 2.1 time: 0.185971 Aug 31 00:40:25.101274 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 338/688] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:24 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:25.209712 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-c1d7eb1d-6798-4be3-b932-ce28593b8dc9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:25.221944 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c1d7eb1d-6798-4be3-b932-ce28593b8dc9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1670 microversion: 2.1 time: 0.221650 Aug 31 00:40:25.224362 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 351/689] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:24 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1670 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:26.021328 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-04a70ca9-b116-4a77-b731-237e634ff240 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:26.021931 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-04a70ca9-b116-4a77-b731-237e634ff240 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:26.029277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04a70ca9-b116-4a77-b731-237e634ff240 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:26.029791 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04a70ca9-b116-4a77-b731-237e634ff240 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:26.030264 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04a70ca9-b116-4a77-b731-237e634ff240 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:26.030990 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04a70ca9-b116-4a77-b731-237e634ff240 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:26.031468 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04a70ca9-b116-4a77-b731-237e634ff240 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:26.031893 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04a70ca9-b116-4a77-b731-237e634ff240 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:26.124130 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f8eea222-3321-4f71-840d-72277a6ebf95 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:26.124778 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f8eea222-3321-4f71-840d-72277a6ebf95 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:26.131722 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f8eea222-3321-4f71-840d-72277a6ebf95 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:26.132175 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f8eea222-3321-4f71-840d-72277a6ebf95 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:26.132590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f8eea222-3321-4f71-840d-72277a6ebf95 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:26.133515 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f8eea222-3321-4f71-840d-72277a6ebf95 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:26.133968 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f8eea222-3321-4f71-840d-72277a6ebf95 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:26.134427 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f8eea222-3321-4f71-840d-72277a6ebf95 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:26.174128 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-04a70ca9-b116-4a77-b731-237e634ff240 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:26.183417 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-04a70ca9-b116-4a77-b731-237e634ff240 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1516 microversion: 2.1 time: 0.166028 Aug 31 00:40:26.186251 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 339/690] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:26 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:26.247774 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-63a1584e-24d3-4ad1-ae88-42be7e7af3cd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:26.248916 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-63a1584e-24d3-4ad1-ae88-42be7e7af3cd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:26.259830 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-63a1584e-24d3-4ad1-ae88-42be7e7af3cd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:26.259830 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-63a1584e-24d3-4ad1-ae88-42be7e7af3cd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:26.259830 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-63a1584e-24d3-4ad1-ae88-42be7e7af3cd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:26.259830 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-63a1584e-24d3-4ad1-ae88-42be7e7af3cd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:26.260846 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-63a1584e-24d3-4ad1-ae88-42be7e7af3cd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:26.260846 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-63a1584e-24d3-4ad1-ae88-42be7e7af3cd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:26.316590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f8eea222-3321-4f71-840d-72277a6ebf95 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:26.326501 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f8eea222-3321-4f71-840d-72277a6ebf95 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1682 microversion: 2.1 time: 0.206957 Aug 31 00:40:26.327229 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 352/691] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:26 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1682 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:26.447845 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-63a1584e-24d3-4ad1-ae88-42be7e7af3cd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:26.450610 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:26.456983 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-63a1584e-24d3-4ad1-ae88-42be7e7af3cd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1670 microversion: 2.1 time: 0.215350 Aug 31 00:40:26.457659 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 340/692] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:26 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1670 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:26.969102 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c4741d2e-6aa8-46f1-bbee-07e593d7c8f8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:26.969631 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c4741d2e-6aa8-46f1-bbee-07e593d7c8f8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:26.975767 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c4741d2e-6aa8-46f1-bbee-07e593d7c8f8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:26.976244 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c4741d2e-6aa8-46f1-bbee-07e593d7c8f8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:26.976707 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c4741d2e-6aa8-46f1-bbee-07e593d7c8f8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:26.977458 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c4741d2e-6aa8-46f1-bbee-07e593d7c8f8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:26.977830 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c4741d2e-6aa8-46f1-bbee-07e593d7c8f8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:26.978304 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c4741d2e-6aa8-46f1-bbee-07e593d7c8f8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:27.003071 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-c4741d2e-6aa8-46f1-bbee-07e593d7c8f8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lazy-loading 'flavor' on Instance uuid 302d7397-56df-414b-a380-afc6b65fc8fa {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:40:27.210593 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-144f4b1d-bbbe-4653-8914-816cadc0bb3e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:27.211950 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-144f4b1d-bbbe-4653-8914-816cadc0bb3e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:27.215855 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:27.220115 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-144f4b1d-bbbe-4653-8914-816cadc0bb3e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:27.220630 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-144f4b1d-bbbe-4653-8914-816cadc0bb3e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:27.221069 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-144f4b1d-bbbe-4653-8914-816cadc0bb3e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:27.221893 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-144f4b1d-bbbe-4653-8914-816cadc0bb3e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:27.223256 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-144f4b1d-bbbe-4653-8914-816cadc0bb3e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:27.223256 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-144f4b1d-bbbe-4653-8914-816cadc0bb3e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:27.390013 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-144f4b1d-bbbe-4653-8914-816cadc0bb3e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:27.397712 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-144f4b1d-bbbe-4653-8914-816cadc0bb3e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1518 microversion: 2.1 time: 0.192237 Aug 31 00:40:27.398477 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 341/693] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:27 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1518 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:27.403595 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-791d2855-c0cf-4a20-b7dd-4425ee4105f1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:27.404200 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-791d2855-c0cf-4a20-b7dd-4425ee4105f1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:27.410953 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-791d2855-c0cf-4a20-b7dd-4425ee4105f1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:27.411345 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-791d2855-c0cf-4a20-b7dd-4425ee4105f1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:27.411783 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-791d2855-c0cf-4a20-b7dd-4425ee4105f1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:27.412943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-791d2855-c0cf-4a20-b7dd-4425ee4105f1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:27.413431 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-791d2855-c0cf-4a20-b7dd-4425ee4105f1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:27.413857 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-791d2855-c0cf-4a20-b7dd-4425ee4105f1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:27.528392 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c4741d2e-6aa8-46f1-bbee-07e593d7c8f8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "POST /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa/action" status: 202 len: 0 microversion: 2.20 time: 0.564082 Aug 31 00:40:27.530706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 353/694] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 31 00:40:26 2022] POST /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:40:27.549205 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d0cd7989-9023-478a-a450-78e8da7deafb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:27.549899 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d0cd7989-9023-478a-a450-78e8da7deafb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:27.565483 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0cd7989-9023-478a-a450-78e8da7deafb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:27.566220 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0cd7989-9023-478a-a450-78e8da7deafb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:27.566904 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0cd7989-9023-478a-a450-78e8da7deafb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:27.568027 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0cd7989-9023-478a-a450-78e8da7deafb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:27.568710 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0cd7989-9023-478a-a450-78e8da7deafb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:27.569308 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0cd7989-9023-478a-a450-78e8da7deafb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:27.632029 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-791d2855-c0cf-4a20-b7dd-4425ee4105f1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:27.640498 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-791d2855-c0cf-4a20-b7dd-4425ee4105f1 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1682 microversion: 2.1 time: 0.240388 Aug 31 00:40:27.652851 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 342/695] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:27 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1682 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:27.672820 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-5540e2ad-3c8c-4081-b585-415fa9f8290a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:27.672820 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-5540e2ad-3c8c-4081-b585-415fa9f8290a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:27.687584 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5540e2ad-3c8c-4081-b585-415fa9f8290a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:27.691121 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5540e2ad-3c8c-4081-b585-415fa9f8290a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:27.691577 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5540e2ad-3c8c-4081-b585-415fa9f8290a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:27.692308 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5540e2ad-3c8c-4081-b585-415fa9f8290a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:27.694544 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5540e2ad-3c8c-4081-b585-415fa9f8290a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:27.697978 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5540e2ad-3c8c-4081-b585-415fa9f8290a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:27.928177 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d0cd7989-9023-478a-a450-78e8da7deafb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:27.938263 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d0cd7989-9023-478a-a450-78e8da7deafb tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1670 microversion: 2.1 time: 0.404860 Aug 31 00:40:27.939051 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 354/696] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:27 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1670 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:27.972198 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-5540e2ad-3c8c-4081-b585-415fa9f8290a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:27.983257 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-5540e2ad-3c8c-4081-b585-415fa9f8290a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:27.985279 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-5540e2ad-3c8c-4081-b585-415fa9f8290a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:27.986779 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-5540e2ad-3c8c-4081-b585-415fa9f8290a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1726 microversion: 2.20 time: 0.332656 Aug 31 00:40:27.988303 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 343/697] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:27 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1726 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:28.419345 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-09521096-e0de-4b76-88e5-dd833cebd1f8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:28.420679 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-09521096-e0de-4b76-88e5-dd833cebd1f8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:28.428005 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-09521096-e0de-4b76-88e5-dd833cebd1f8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:28.428375 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-09521096-e0de-4b76-88e5-dd833cebd1f8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:28.428816 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-09521096-e0de-4b76-88e5-dd833cebd1f8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:28.429587 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-09521096-e0de-4b76-88e5-dd833cebd1f8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:28.430164 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-09521096-e0de-4b76-88e5-dd833cebd1f8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:28.430583 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-09521096-e0de-4b76-88e5-dd833cebd1f8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:28.666044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-180bbd07-e6f6-4bff-9454-43cebc4d9631 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:28.666648 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-180bbd07-e6f6-4bff-9454-43cebc4d9631 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:28.688934 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-09521096-e0de-4b76-88e5-dd833cebd1f8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:28.703583 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-09521096-e0de-4b76-88e5-dd833cebd1f8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1518 microversion: 2.1 time: 0.288207 Aug 31 00:40:28.704173 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 355/698] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:28 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1518 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:28.722025 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-180bbd07-e6f6-4bff-9454-43cebc4d9631 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:28.722559 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-180bbd07-e6f6-4bff-9454-43cebc4d9631 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:28.722953 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-180bbd07-e6f6-4bff-9454-43cebc4d9631 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:28.723666 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-180bbd07-e6f6-4bff-9454-43cebc4d9631 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:28.724123 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-180bbd07-e6f6-4bff-9454-43cebc4d9631 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:28.724588 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-180bbd07-e6f6-4bff-9454-43cebc4d9631 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:28.867695 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-180bbd07-e6f6-4bff-9454-43cebc4d9631 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:28.874051 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-180bbd07-e6f6-4bff-9454-43cebc4d9631 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1614 microversion: 2.1 time: 0.211947 Aug 31 00:40:28.876823 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 344/699] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:28 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1614 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:28.966195 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-fbbbe966-6e0a-4a25-b223-d222ac0ec651 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:28.966195 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-fbbbe966-6e0a-4a25-b223-d222ac0ec651 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:28.972857 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-08afab0b-c44c-41ce-a7ed-a9403848c113 req-bea5f78a-ad56-4259-837d-1b7ae3eac58d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07dc2669-6605-431c-93a5-884348c09ebf", "name": "network-vif-deleted", "tag": "53407fde-ade2-453c-975e-4fafb7f9e4d5"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:28.973080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fbbbe966-6e0a-4a25-b223-d222ac0ec651 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:28.973741 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fbbbe966-6e0a-4a25-b223-d222ac0ec651 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:28.976603 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fbbbe966-6e0a-4a25-b223-d222ac0ec651 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:28.977551 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fbbbe966-6e0a-4a25-b223-d222ac0ec651 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:28.979024 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fbbbe966-6e0a-4a25-b223-d222ac0ec651 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:28.980699 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fbbbe966-6e0a-4a25-b223-d222ac0ec651 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:28.985074 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-08afab0b-c44c-41ce-a7ed-a9403848c113 req-bea5f78a-ad56-4259-837d-1b7ae3eac58d service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:28.985555 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-08afab0b-c44c-41ce-a7ed-a9403848c113 req-bea5f78a-ad56-4259-837d-1b7ae3eac58d service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:28.988208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-08afab0b-c44c-41ce-a7ed-a9403848c113 req-bea5f78a-ad56-4259-837d-1b7ae3eac58d service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:29.005203 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:29.026141 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-08afab0b-c44c-41ce-a7ed-a9403848c113 req-bea5f78a-ad56-4259-837d-1b7ae3eac58d service nova] Creating event network-vif-deleted:53407fde-ade2-453c-975e-4fafb7f9e4d5 for instance 07dc2669-6605-431c-93a5-884348c09ebf on hv-cinder-85221 Aug 31 00:40:29.038530 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-08afab0b-c44c-41ce-a7ed-a9403848c113 req-bea5f78a-ad56-4259-837d-1b7ae3eac58d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.327088 Aug 31 00:40:29.042706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 356/700] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:29.069691 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-90cc8093-984e-4f47-8e9e-ef47f2813b89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:29.070404 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-90cc8093-984e-4f47-8e9e-ef47f2813b89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:29.082882 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-90cc8093-984e-4f47-8e9e-ef47f2813b89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:29.098210 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-90cc8093-984e-4f47-8e9e-ef47f2813b89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:29.098915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-90cc8093-984e-4f47-8e9e-ef47f2813b89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:29.099859 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-90cc8093-984e-4f47-8e9e-ef47f2813b89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:29.100667 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-90cc8093-984e-4f47-8e9e-ef47f2813b89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:29.101258 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-90cc8093-984e-4f47-8e9e-ef47f2813b89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:29.163303 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fbbbe966-6e0a-4a25-b223-d222ac0ec651 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:29.180162 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-fbbbe966-6e0a-4a25-b223-d222ac0ec651 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1604 microversion: 2.1 time: 0.221250 Aug 31 00:40:29.180817 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 345/701] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:28 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1604 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:29.194913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-4a4b302b-eca0-447b-b878-96cd9bb7548e req-0aa4f908-d4c2-4ca1-bbd5-b921e11420f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24bd8f41-5ce3-4260-bd3e-d98a55817bfd", "name": "network-vif-deleted", "tag": "b850ca23-da95-4ccb-9aff-d53185c76064"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:29.222754 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-4a4b302b-eca0-447b-b878-96cd9bb7548e req-0aa4f908-d4c2-4ca1-bbd5-b921e11420f2 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:29.225397 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-4a4b302b-eca0-447b-b878-96cd9bb7548e req-0aa4f908-d4c2-4ca1-bbd5-b921e11420f2 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:29.228839 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-4a4b302b-eca0-447b-b878-96cd9bb7548e req-0aa4f908-d4c2-4ca1-bbd5-b921e11420f2 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:29.245581 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-4a4b302b-eca0-447b-b878-96cd9bb7548e req-0aa4f908-d4c2-4ca1-bbd5-b921e11420f2 service nova] Creating event network-vif-deleted:b850ca23-da95-4ccb-9aff-d53185c76064 for instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd on hv-cinder-85221 Aug 31 00:40:29.252840 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-4a4b302b-eca0-447b-b878-96cd9bb7548e req-0aa4f908-d4c2-4ca1-bbd5-b921e11420f2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070571 Aug 31 00:40:29.253876 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 346/702] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:29.352482 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-90cc8093-984e-4f47-8e9e-ef47f2813b89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:29.362180 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-90cc8093-984e-4f47-8e9e-ef47f2813b89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:29.363994 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-90cc8093-984e-4f47-8e9e-ef47f2813b89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:29.365643 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-90cc8093-984e-4f47-8e9e-ef47f2813b89 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1726 microversion: 2.20 time: 0.318826 Aug 31 00:40:29.384461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 357/703] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:29 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1726 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:29.727936 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d9683f90-b76e-4214-8a7d-8340e548c35c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:29.729428 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d9683f90-b76e-4214-8a7d-8340e548c35c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:29.738511 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9683f90-b76e-4214-8a7d-8340e548c35c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:29.739030 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9683f90-b76e-4214-8a7d-8340e548c35c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:29.739494 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9683f90-b76e-4214-8a7d-8340e548c35c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:29.740200 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9683f90-b76e-4214-8a7d-8340e548c35c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:29.740693 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9683f90-b76e-4214-8a7d-8340e548c35c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:29.741116 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d9683f90-b76e-4214-8a7d-8340e548c35c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:29.904466 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-72866313-034f-4afb-9fb4-7752fdceb0bb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:29.905144 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-72866313-034f-4afb-9fb4-7752fdceb0bb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:29.909157 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d9683f90-b76e-4214-8a7d-8340e548c35c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:29.914606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-72866313-034f-4afb-9fb4-7752fdceb0bb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:29.915158 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-72866313-034f-4afb-9fb4-7752fdceb0bb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:29.915761 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-72866313-034f-4afb-9fb4-7752fdceb0bb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:29.916983 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-72866313-034f-4afb-9fb4-7752fdceb0bb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:29.917454 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-72866313-034f-4afb-9fb4-7752fdceb0bb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:29.917873 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-72866313-034f-4afb-9fb4-7752fdceb0bb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:29.920624 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d9683f90-b76e-4214-8a7d-8340e548c35c tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1574 microversion: 2.1 time: 0.197219 Aug 31 00:40:29.921718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 347/704] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:29 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1574 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:29.931847 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-88a98798-8c7f-4a18-aec2-a042291382f1 tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] Calling method '.version_select at 0x7f551ea9d550>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:29.993891 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-72866313-034f-4afb-9fb4-7752fdceb0bb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:29.994392 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-72866313-034f-4afb-9fb4-7752fdceb0bb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:29.994829 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-72866313-034f-4afb-9fb4-7752fdceb0bb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:29.995296 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-72866313-034f-4afb-9fb4-7752fdceb0bb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lazy-loading 'fault' on Instance uuid 24bd8f41-5ce3-4260-bd3e-d98a55817bfd {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:40:30.058220 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-72866313-034f-4afb-9fb4-7752fdceb0bb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:30.073582 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-88a98798-8c7f-4a18-aec2-a042291382f1 tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/667cf8ac-be98-4cb6-a119-1428c765bd40" status: 200 len: 351 microversion: 2.1 time: 0.150806 Aug 31 00:40:30.074452 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 348/705] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 00:40:29 2022] GET /compute/v2.1/os-volumes/667cf8ac-be98-4cb6-a119-1428c765bd40 => generated 351 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:30.082305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-72866313-034f-4afb-9fb4-7752fdceb0bb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 200 len: 1332 microversion: 2.1 time: 0.181441 Aug 31 00:40:30.082305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 358/706] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:29 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 1332 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:30.205792 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-80bd8edf-080e-4108-8afa-894e6b7dcf60 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:30.206647 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-80bd8edf-080e-4108-8afa-894e6b7dcf60 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:30.218697 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-80bd8edf-080e-4108-8afa-894e6b7dcf60 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:30.219084 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-80bd8edf-080e-4108-8afa-894e6b7dcf60 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:30.219518 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-80bd8edf-080e-4108-8afa-894e6b7dcf60 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:30.220274 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-80bd8edf-080e-4108-8afa-894e6b7dcf60 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:30.220697 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-80bd8edf-080e-4108-8afa-894e6b7dcf60 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:30.225867 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-80bd8edf-080e-4108-8afa-894e6b7dcf60 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:30.262990 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-80bd8edf-080e-4108-8afa-894e6b7dcf60 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:30.263673 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-80bd8edf-080e-4108-8afa-894e6b7dcf60 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:30.264087 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-80bd8edf-080e-4108-8afa-894e6b7dcf60 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:30.264565 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-80bd8edf-080e-4108-8afa-894e6b7dcf60 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lazy-loading 'fault' on Instance uuid 07dc2669-6605-431c-93a5-884348c09ebf {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:40:30.314591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-80bd8edf-080e-4108-8afa-894e6b7dcf60 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:30.327089 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-80bd8edf-080e-4108-8afa-894e6b7dcf60 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 200 len: 1327 microversion: 2.1 time: 0.121343 Aug 31 00:40:30.328391 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 349/707] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:30 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 1327 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:30.396887 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ec59d002-5f52-40ad-8708-9706cba9af3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:30.396887 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ec59d002-5f52-40ad-8708-9706cba9af3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:30.398113 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec59d002-5f52-40ad-8708-9706cba9af3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:30.398601 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec59d002-5f52-40ad-8708-9706cba9af3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:30.399034 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec59d002-5f52-40ad-8708-9706cba9af3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:30.399983 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec59d002-5f52-40ad-8708-9706cba9af3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:30.400457 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec59d002-5f52-40ad-8708-9706cba9af3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:30.400881 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ec59d002-5f52-40ad-8708-9706cba9af3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:30.575756 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ec59d002-5f52-40ad-8708-9706cba9af3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:30.584149 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ec59d002-5f52-40ad-8708-9706cba9af3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:30.586078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ec59d002-5f52-40ad-8708-9706cba9af3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:30.587115 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ec59d002-5f52-40ad-8708-9706cba9af3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1726 microversion: 2.20 time: 0.200553 Aug 31 00:40:30.587675 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 359/708] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:30 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1726 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:31.030770 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-56614a34-fae2-4a59-bb75-b27e2d3f4381 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:31.031380 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-56614a34-fae2-4a59-bb75-b27e2d3f4381 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:31.038805 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-56614a34-fae2-4a59-bb75-b27e2d3f4381 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:31.038805 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-56614a34-fae2-4a59-bb75-b27e2d3f4381 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:31.039081 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-56614a34-fae2-4a59-bb75-b27e2d3f4381 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:31.040092 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-56614a34-fae2-4a59-bb75-b27e2d3f4381 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:31.040190 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-56614a34-fae2-4a59-bb75-b27e2d3f4381 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:31.040583 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-56614a34-fae2-4a59-bb75-b27e2d3f4381 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:31.107956 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3c53e843-b41c-442f-834f-f95c1eafecd6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:31.108601 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-3c53e843-b41c-442f-834f-f95c1eafecd6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:31.115358 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3c53e843-b41c-442f-834f-f95c1eafecd6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:31.116117 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3c53e843-b41c-442f-834f-f95c1eafecd6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:31.116286 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3c53e843-b41c-442f-834f-f95c1eafecd6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:31.117105 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3c53e843-b41c-442f-834f-f95c1eafecd6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:31.117801 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3c53e843-b41c-442f-834f-f95c1eafecd6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:31.117967 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3c53e843-b41c-442f-834f-f95c1eafecd6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:31.133810 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-3c53e843-b41c-442f-834f-f95c1eafecd6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] HTTP exception thrown: Instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd could not be found. Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3c53e843-b41c-442f-834f-f95c1eafecd6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Request method failure captured: Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd HTTP/1.1 Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqy7MJOpqb7URH2NMlvnlry7FN8PMqekPyTr4WdpuFP-EJ4P09V7u5pIkcg9D2y64tDq06EhUYjkLoVEA5Xo6OkeLUr7BvIjtmrEoq-poVSUiJYXz83e0U_QXEU4_Gc_m-Y7QkotdhwKhL3RvXqk7a5HcYY_0K_fB-YMAW3D8wMuR_c Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:40:31.135779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:40:31.139244 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:40:31.139244 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:40:31.139244 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:40:31.139244 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:40:31.139244 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:40:31.139244 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:40:31.139244 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:40:31.139244 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 45422a67a78f4784abc0f18ad84778f3 Aug 31 00:40:31.139244 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:40:31.139244 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:40:31.139244 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd could not be found. Aug 31 00:40:31.139244 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': '24bd8f41-5ce3-4260-bd3e-d98a55817bfd'} Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd could not be found. Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:40:31.140282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:40:31.141996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:40:31.141996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:40:31.141996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:40:31.141996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:40:31.141996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:40:31.141996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:40:31.141996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:40:31.141996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd could not be found. Aug 31 00:40:31.141996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:31.141996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:40:31.141996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:31.141996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:40:31.141996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:40:31.141996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:40:31.141996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:40:31.141996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:40:31.141996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd could not be found. Aug 31 00:40:31.141996 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:40:31.144019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3c53e843-b41c-442f-834f-f95c1eafecd6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Returning 404 to user: Instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:40:31.144019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-3c53e843-b41c-442f-834f-f95c1eafecd6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 404 len: 111 microversion: 2.1 time: 0.033586 Aug 31 00:40:31.144019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 360/709] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:31 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:40:31.146869 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6d3bd124-354d-4482-977b-6d8be90ff56f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '.version_select at 0x7f551e95d700>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:31.195579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-56614a34-fae2-4a59-bb75-b27e2d3f4381 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:31.203627 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-56614a34-fae2-4a59-bb75-b27e2d3f4381 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1574 microversion: 2.1 time: 0.177353 Aug 31 00:40:31.204201 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 350/710] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:31 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:31.245320 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6d3bd124-354d-4482-977b-6d8be90ff56f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053373980" status: 202 len: 0 microversion: 2.1 time: 0.102325 Aug 31 00:40:31.246007 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 361/711] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Aug 31 00:40:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053373980 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:40:31.349362 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-df48f652-1fef-4fee-abe9-ba9ef991012b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:31.350052 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-df48f652-1fef-4fee-abe9-ba9ef991012b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:31.356228 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-df48f652-1fef-4fee-abe9-ba9ef991012b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:31.356845 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-df48f652-1fef-4fee-abe9-ba9ef991012b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:31.357340 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-df48f652-1fef-4fee-abe9-ba9ef991012b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:31.358083 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-df48f652-1fef-4fee-abe9-ba9ef991012b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:31.358529 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-df48f652-1fef-4fee-abe9-ba9ef991012b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:31.358948 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-df48f652-1fef-4fee-abe9-ba9ef991012b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:31.373095 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-df48f652-1fef-4fee-abe9-ba9ef991012b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] HTTP exception thrown: Instance 07dc2669-6605-431c-93a5-884348c09ebf could not be found. Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-df48f652-1fef-4fee-abe9-ba9ef991012b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Request method failure captured: Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf HTTP/1.1 Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDq0WcVgXUj-iqbCzauuWxIXx3hi4_qofZE82BYx5XOikwDxchIHG520fBqtCYl8cHU47fOUFJjBDdp5W2EMi347kZ7PFY4_KwJsO5Cgqpj9kW91f6fX6N-8ZpONm6hXbuBuk3igNnJOQyNIEN49-Y7ZRbQSAmkqn5wWcGZtLr093DRU Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: 5023455241594360bacff911a6641d7a Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-AttachVolumeTestJSON-793970641 Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:40:31.374974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:40:31.376446 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5023455241594360bacff911a6641d7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5023455241594360bacff911a6641d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5023455241594360bacff911a6641d7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5023455241594360bacff911a6641d7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:40:31.376446 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-AttachVolumeTestJSON-793970641 Aug 31 00:40:31.376446 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: 5023455241594360bacff911a6641d7a Aug 31 00:40:31.376446 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-AttachVolumeTestJSON-793970641 Aug 31 00:40:31.376446 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-AttachVolumeTestJSON-793970641-project Aug 31 00:40:31.376446 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:40:31.376446 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:40:31.376446 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: ac2476465c4c4bd2b1cf81934b6e9a7d Aug 31 00:40:31.376446 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-AttachVolumeTestJSON-793970641-project Aug 31 00:40:31.376446 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:40:31.376446 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance 07dc2669-6605-431c-93a5-884348c09ebf could not be found. Aug 31 00:40:31.376446 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': '07dc2669-6605-431c-93a5-884348c09ebf'} Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07dc2669-6605-431c-93a5-884348c09ebf could not be found. Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:40:31.377321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:40:31.378831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:40:31.378831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:40:31.378831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:40:31.378831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:40:31.378831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:40:31.378831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:40:31.378831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:40:31.378831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07dc2669-6605-431c-93a5-884348c09ebf could not be found. Aug 31 00:40:31.378831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:40:31.378831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:40:31.378831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:40:31.378831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:40:31.378831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:40:31.378831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:40:31.378831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:40:31.378831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:40:31.378831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07dc2669-6605-431c-93a5-884348c09ebf could not be found. Aug 31 00:40:31.378831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:40:31.380067 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-df48f652-1fef-4fee-abe9-ba9ef991012b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Returning 404 to user: Instance 07dc2669-6605-431c-93a5-884348c09ebf could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:40:31.380067 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-df48f652-1fef-4fee-abe9-ba9ef991012b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 404 len: 111 microversion: 2.1 time: 0.031365 Aug 31 00:40:31.380800 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 351/712] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:31 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:40:31.386981 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d431b8a1-f99c-44e2-9285-407357a7e6b3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '.version_select at 0x7f551e90c160>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:31.497684 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d431b8a1-f99c-44e2-9285-407357a7e6b3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-460130469" status: 202 len: 0 microversion: 2.1 time: 0.114165 Aug 31 00:40:31.498365 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 362/713] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Aug 31 00:40:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-460130469 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:40:31.611027 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-cee75ad8-9ccc-4166-8e93-3e2061c8385d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:31.611670 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-cee75ad8-9ccc-4166-8e93-3e2061c8385d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:31.618793 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cee75ad8-9ccc-4166-8e93-3e2061c8385d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:31.619279 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cee75ad8-9ccc-4166-8e93-3e2061c8385d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:31.619717 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cee75ad8-9ccc-4166-8e93-3e2061c8385d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:31.620456 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cee75ad8-9ccc-4166-8e93-3e2061c8385d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:31.621087 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cee75ad8-9ccc-4166-8e93-3e2061c8385d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:31.622273 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cee75ad8-9ccc-4166-8e93-3e2061c8385d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:31.761373 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-cee75ad8-9ccc-4166-8e93-3e2061c8385d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:31.770979 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-cee75ad8-9ccc-4166-8e93-3e2061c8385d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:31.772660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-cee75ad8-9ccc-4166-8e93-3e2061c8385d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:31.775205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-cee75ad8-9ccc-4166-8e93-3e2061c8385d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1726 microversion: 2.20 time: 0.167172 Aug 31 00:40:31.776539 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 352/714] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:31 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:31.942396 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6640b456-a6b0-401e-acf4-91a9a3879be6 tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] Calling method '.version_select at 0x7f551e90c9d0>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:32.003300 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6640b456-a6b0-401e-acf4-91a9a3879be6 tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f68e73c5-cd82-47e2-94c6-6452bc1a5d9b" status: 200 len: 350 microversion: 2.1 time: 0.064894 Aug 31 00:40:32.004595 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 363/715] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 00:40:31 2022] GET /compute/v2.1/os-volumes/f68e73c5-cd82-47e2-94c6-6452bc1a5d9b => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:32.226825 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ab182303-ab94-41a5-92eb-613f720f0b03 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:32.227554 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ab182303-ab94-41a5-92eb-613f720f0b03 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:32.235118 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ab182303-ab94-41a5-92eb-613f720f0b03 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:32.235710 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ab182303-ab94-41a5-92eb-613f720f0b03 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:32.236459 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ab182303-ab94-41a5-92eb-613f720f0b03 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:32.237082 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ab182303-ab94-41a5-92eb-613f720f0b03 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:32.237572 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ab182303-ab94-41a5-92eb-613f720f0b03 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:32.238073 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ab182303-ab94-41a5-92eb-613f720f0b03 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:32.387038 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3af52c14-63dc-4b1e-9a19-c9a57ca023c9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Action: 'create', calling method: .version_select at 0x7f551e90c040>, body: {"keypair": {"name": "tempest-keypair-916822675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNgNZqxCIaomy4sNKoqXZipsquEz+WxK9iT1bEEnOths7Mmut+o8b2o9IHC/B0/TegDr0b571A2NsTrxIaMtDjqjcQocCbsNQ3paPTwDAtOl7h0itcoTf8nAxAL2XNRGw=="}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:32.406014 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-3af52c14-63dc-4b1e-9a19-c9a57ca023c9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Getting quotas for project 5023455241594360bacff911a6641d7a. Resources: {'key_pairs'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:40:32.409849 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-3af52c14-63dc-4b1e-9a19-c9a57ca023c9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Getting quotas for user ac2476465c4c4bd2b1cf81934b6e9a7d and project 5023455241594360bacff911a6641d7a. Resources: {'key_pairs'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:40:32.475537 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ab182303-ab94-41a5-92eb-613f720f0b03 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:32.486323 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ab182303-ab94-41a5-92eb-613f720f0b03 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1574 microversion: 2.1 time: 0.263879 Aug 31 00:40:32.487273 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 353/716] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:32 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1574 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:32.498302 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a154464f-616a-4d59-8a89-5a57049c32d7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Action: 'create', calling method: .version_select at 0x7f551ea2d0d0>, body: {"keypair": {"name": "tempest-keypair-1504529481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlX/loUneujXh9mf9/sGkIPMR+x5NqPvDV9IUGMnprctXvgx1GStE/V7DGzZ0xy1elnJS0ynwYQc2jDtxML2cP5cmDAeCVOmx69u/daWv+VAtqQx5WDNh/lNjGdtDhBJw=="}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:32.514397 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-3af52c14-63dc-4b1e-9a19-c9a57ca023c9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.131065 Aug 31 00:40:32.514980 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-a154464f-616a-4d59-8a89-5a57049c32d7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Getting quotas for project ec5893d9a55f4ed28f6579397d0d6f21. Resources: {'key_pairs'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:40:32.515202 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 364/717] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 00:40:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:32.521268 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-a154464f-616a-4d59-8a89-5a57049c32d7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Getting quotas for user 45422a67a78f4784abc0f18ad84778f3 and project ec5893d9a55f4ed28f6579397d0d6f21. Resources: {'key_pairs'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:40:32.624280 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a154464f-616a-4d59-8a89-5a57049c32d7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.129810 Aug 31 00:40:32.625026 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 354/718] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 00:40:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:32.799339 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d2713dc8-8753-4c4d-97db-1d132e50a1e4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:32.800101 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d2713dc8-8753-4c4d-97db-1d132e50a1e4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:32.806956 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d2713dc8-8753-4c4d-97db-1d132e50a1e4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:32.807736 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d2713dc8-8753-4c4d-97db-1d132e50a1e4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:32.808406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d2713dc8-8753-4c4d-97db-1d132e50a1e4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:32.809389 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d2713dc8-8753-4c4d-97db-1d132e50a1e4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:32.810055 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d2713dc8-8753-4c4d-97db-1d132e50a1e4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:32.810711 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d2713dc8-8753-4c4d-97db-1d132e50a1e4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:32.990275 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d2713dc8-8753-4c4d-97db-1d132e50a1e4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:32.998998 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d2713dc8-8753-4c4d-97db-1d132e50a1e4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:33.000520 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d2713dc8-8753-4c4d-97db-1d132e50a1e4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:33.001819 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d2713dc8-8753-4c4d-97db-1d132e50a1e4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1726 microversion: 2.20 time: 0.206380 Aug 31 00:40:33.002414 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 365/719] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:32 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1726 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:33.507784 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-20d80584-09a9-454a-b3d0-fea9fdecf40b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:33.508511 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-20d80584-09a9-454a-b3d0-fea9fdecf40b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:33.516181 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-20d80584-09a9-454a-b3d0-fea9fdecf40b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:33.516824 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-20d80584-09a9-454a-b3d0-fea9fdecf40b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:33.522015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-20d80584-09a9-454a-b3d0-fea9fdecf40b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:33.522015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-20d80584-09a9-454a-b3d0-fea9fdecf40b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:33.522015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-20d80584-09a9-454a-b3d0-fea9fdecf40b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:33.522015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-20d80584-09a9-454a-b3d0-fea9fdecf40b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:33.694170 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-20d80584-09a9-454a-b3d0-fea9fdecf40b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:33.707554 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-20d80584-09a9-454a-b3d0-fea9fdecf40b tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1574 microversion: 2.1 time: 0.203465 Aug 31 00:40:33.709969 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 355/720] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:33 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1574 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:33.781334 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d45c6195-3f8c-4092-ab7f-777d748a5f1c tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] Calling method '.version_select at 0x7f551e9425e0>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:33.833797 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d45c6195-3f8c-4092-ab7f-777d748a5f1c tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/6baab695-5454-4dca-b194-1354a42f59dc" status: 200 len: 351 microversion: 2.1 time: 0.056609 Aug 31 00:40:33.834348 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 366/721] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 00:40:33 2022] GET /compute/v2.1/os-volumes/6baab695-5454-4dca-b194-1354a42f59dc => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:33.847612 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a0041480-fb0b-4a3b-b83e-69f1547c9625 tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] Calling method '.version_select at 0x7f551eba8040>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:33.937025 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a0041480-fb0b-4a3b-b83e-69f1547c9625 tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.092996 Aug 31 00:40:33.938348 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 356/722] 10.222.0.65 () {58 vars in 1134 bytes} [Wed Aug 31 00:40:33 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:33.953343 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4ac107b0-2763-4869-a9f9-9983e3e722c4 tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] Calling method '.version_select at 0x7f551e90cd30>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:34.026869 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-857a6f74-44b5-4f33-8879-4be4409e4555 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:34.027478 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-857a6f74-44b5-4f33-8879-4be4409e4555 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:34.034234 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-857a6f74-44b5-4f33-8879-4be4409e4555 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:34.035107 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-857a6f74-44b5-4f33-8879-4be4409e4555 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:34.035849 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-857a6f74-44b5-4f33-8879-4be4409e4555 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:34.036891 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-857a6f74-44b5-4f33-8879-4be4409e4555 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:34.037507 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-857a6f74-44b5-4f33-8879-4be4409e4555 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:34.038004 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-857a6f74-44b5-4f33-8879-4be4409e4555 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:34.061590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4ac107b0-2763-4869-a9f9-9983e3e722c4 tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.112989 Aug 31 00:40:34.068130 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 367/723] 10.222.0.65 () {58 vars in 1149 bytes} [Wed Aug 31 00:40:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:34.078309 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3f756c59-1178-494a-be13-230fba682cd7 tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] Calling method '.version_select at 0x7f551e908430>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:34.169463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-3f756c59-1178-494a-be13-230fba682cd7 tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.096270 Aug 31 00:40:34.170036 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 368/724] 10.222.0.65 () {58 vars in 1134 bytes} [Wed Aug 31 00:40:34 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:34.182591 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-7378342e-7178-47bf-92d4-ccd668eff949 tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] Calling method '.version_select at 0x7f551e908c10>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:34.190570 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-857a6f74-44b5-4f33-8879-4be4409e4555 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:34.198516 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-857a6f74-44b5-4f33-8879-4be4409e4555 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:34.200784 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-857a6f74-44b5-4f33-8879-4be4409e4555 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:34.202281 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-857a6f74-44b5-4f33-8879-4be4409e4555 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1726 microversion: 2.20 time: 0.180089 Aug 31 00:40:34.203015 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 357/725] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:34 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:34.284168 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-7378342e-7178-47bf-92d4-ccd668eff949 tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.105153 Aug 31 00:40:34.289460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 369/726] 10.222.0.65 () {58 vars in 1167 bytes} [Wed Aug 31 00:40:34 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:34.299353 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a4c5d3b7-7643-479e-9d2b-41bbbc04597f tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] Calling method '.version_select at 0x7f551ec04dc0>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:34.550456 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a4c5d3b7-7643-479e-9d2b-41bbbc04597f tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.255032 Aug 31 00:40:34.551714 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 358/727] 10.222.0.65 () {58 vars in 1170 bytes} [Wed Aug 31 00:40:34 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:34.566579 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0d1cc177-338b-4481-a59a-29f294fd6c63 tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] Calling method '.version_select at 0x7f551e90c8b0>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:34.669765 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-0d1cc177-338b-4481-a59a-29f294fd6c63 tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.107114 Aug 31 00:40:34.670423 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 370/728] 10.222.0.65 () {58 vars in 1155 bytes} [Wed Aug 31 00:40:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:34.686655 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-606ea12a-dbb0-41e9-b459-5ee1ac65d9e1 tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] Calling method '.version_select at 0x7f551ead8e50>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:34.742103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-94f9ca9e-6828-44d0-9cf1-8f74ba2fe6f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:34.743138 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-94f9ca9e-6828-44d0-9cf1-8f74ba2fe6f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:34.750325 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-94f9ca9e-6828-44d0-9cf1-8f74ba2fe6f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:34.750854 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-94f9ca9e-6828-44d0-9cf1-8f74ba2fe6f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:34.751350 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-94f9ca9e-6828-44d0-9cf1-8f74ba2fe6f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:34.752065 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-94f9ca9e-6828-44d0-9cf1-8f74ba2fe6f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:34.752557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-94f9ca9e-6828-44d0-9cf1-8f74ba2fe6f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:34.752978 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-94f9ca9e-6828-44d0-9cf1-8f74ba2fe6f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:34.780124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-606ea12a-dbb0-41e9-b459-5ee1ac65d9e1 tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.099452 Aug 31 00:40:34.781223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 359/729] 10.222.0.65 () {58 vars in 1188 bytes} [Wed Aug 31 00:40:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:34.795730 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-5a2f7082-81a2-44f0-a9ce-828d1725804c tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] Calling method '.version_select at 0x7f551ead88b0>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:34.895390 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-5a2f7082-81a2-44f0-a9ce-828d1725804c tempest-VolumesTestJSON-2079823075 tempest-VolumesTestJSON-2079823075-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.104674 Aug 31 00:40:34.896028 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 360/730] 10.222.0.65 () {58 vars in 1155 bytes} [Wed Aug 31 00:40:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:34.930620 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-94f9ca9e-6828-44d0-9cf1-8f74ba2fe6f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:34.941398 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-94f9ca9e-6828-44d0-9cf1-8f74ba2fe6f0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1574 microversion: 2.1 time: 0.203446 Aug 31 00:40:34.957141 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 371/731] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:34 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1574 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:34.968749 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c1f8541e-e389-4bcc-aaf9-265bff567b38 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1312602821", "imageRef": "12947ed8-8ca9-442d-9224-509e79a198e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5ba44fa-fe70-448e-874e-97120592a817"}], "security_groups": [{"name": "tempest-securitygroup--1826114028"}], "key_name": "tempest-keypair-916822675", "user_data": "}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:35.120469 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.network.neutron [None req-c1f8541e-e389-4bcc-aaf9-265bff567b38 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] validate_networks() for [('a5ba44fa-fe70-448e-874e-97120592a817', None, None, None, None, None)] {{(pid=128048) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:40:35.227437 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0c52b90a-b3ff-424d-9c69-3c2c1881fc1a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:35.228059 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-0c52b90a-b3ff-424d-9c69-3c2c1881fc1a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:35.235105 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0c52b90a-b3ff-424d-9c69-3c2c1881fc1a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:35.235626 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0c52b90a-b3ff-424d-9c69-3c2c1881fc1a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:35.236069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0c52b90a-b3ff-424d-9c69-3c2c1881fc1a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:35.236810 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0c52b90a-b3ff-424d-9c69-3c2c1881fc1a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:35.237306 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0c52b90a-b3ff-424d-9c69-3c2c1881fc1a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:35.237730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0c52b90a-b3ff-424d-9c69-3c2c1881fc1a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:35.382610 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-0c52b90a-b3ff-424d-9c69-3c2c1881fc1a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:35.393939 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-0c52b90a-b3ff-424d-9c69-3c2c1881fc1a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:35.401025 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-0c52b90a-b3ff-424d-9c69-3c2c1881fc1a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:35.401025 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-0c52b90a-b3ff-424d-9c69-3c2c1881fc1a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1726 microversion: 2.20 time: 0.173696 Aug 31 00:40:35.401025 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 372/732] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:35 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:40:35.470892 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3fc762e1-e10d-4a5f-a195-010d97e21286 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-338308211", "imageRef": "12947ed8-8ca9-442d-9224-509e79a198e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d427232-8e26-4216-9399-96dea4f30f86"}], "security_groups": [{"name": "tempest-securitygroup--1597204056"}], "key_name": "tempest-keypair-1504529481", "user_data": "}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:35.576708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.network.neutron [None req-3fc762e1-e10d-4a5f-a195-010d97e21286 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] validate_networks() for [('6d427232-8e26-4216-9399-96dea4f30f86', None, None, None, None, None)] {{(pid=128049) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:40:35.674151 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-c1f8541e-e389-4bcc-aaf9-265bff567b38 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Flavor limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:40:35.674648 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-c1f8541e-e389-4bcc-aaf9-265bff567b38 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Image limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:40:35.675052 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-c1f8541e-e389-4bcc-aaf9-265bff567b38 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Flavor pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:40:35.675440 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-c1f8541e-e389-4bcc-aaf9-265bff567b38 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Image pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:40:35.675936 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-c1f8541e-e389-4bcc-aaf9-265bff567b38 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:40:35.686267 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c1f8541e-e389-4bcc-aaf9-265bff567b38 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:35.687905 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c1f8541e-e389-4bcc-aaf9-265bff567b38 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:35.687905 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c1f8541e-e389-4bcc-aaf9-265bff567b38 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:35.688237 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c1f8541e-e389-4bcc-aaf9-265bff567b38 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:35.688555 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c1f8541e-e389-4bcc-aaf9-265bff567b38 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:35.689020 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c1f8541e-e389-4bcc-aaf9-265bff567b38 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:35.707326 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-c1f8541e-e389-4bcc-aaf9-265bff567b38 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Getting quotas for project 5023455241594360bacff911a6641d7a. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:40:35.711554 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-c1f8541e-e389-4bcc-aaf9-265bff567b38 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Getting quotas for user ac2476465c4c4bd2b1cf81934b6e9a7d and project 5023455241594360bacff911a6641d7a. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:40:35.727034 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c1f8541e-e389-4bcc-aaf9-265bff567b38 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Going to run 1 instances... {{(pid=128048) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:40:35.729534 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c1f8541e-e389-4bcc-aaf9-265bff567b38 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12947ed8-8ca9-442d-9224-509e79a198e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128048) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:40:35.906204 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-c1f8541e-e389-4bcc-aaf9-265bff567b38 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.942204 Aug 31 00:40:35.907028 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 361/733] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:40:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:40:35.919279 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-4b4f4572-4583-4518-8b86-4f4f85bb0078 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:35.920000 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-4b4f4572-4583-4518-8b86-4f4f85bb0078 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:35.983480 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4b4f4572-4583-4518-8b86-4f4f85bb0078 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:35.993104 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-4b4f4572-4583-4518-8b86-4f4f85bb0078 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1237 microversion: 2.1 time: 0.078309 Aug 31 00:40:36.003875 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 362/734] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:35 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1237 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:36.003875 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-3cfefd4b-3df7-4d75-9590-cb835a1610c2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:36.003875 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-3cfefd4b-3df7-4d75-9590-cb835a1610c2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:36.010741 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3cfefd4b-3df7-4d75-9590-cb835a1610c2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:36.011696 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3cfefd4b-3df7-4d75-9590-cb835a1610c2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:36.012773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3cfefd4b-3df7-4d75-9590-cb835a1610c2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:36.013519 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3cfefd4b-3df7-4d75-9590-cb835a1610c2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:36.013965 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3cfefd4b-3df7-4d75-9590-cb835a1610c2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:36.014387 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3cfefd4b-3df7-4d75-9590-cb835a1610c2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:36.031423 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-3fc762e1-e10d-4a5f-a195-010d97e21286 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Flavor limits 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:40:36.031956 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-3fc762e1-e10d-4a5f-a195-010d97e21286 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Image limits 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:40:36.032433 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-3fc762e1-e10d-4a5f-a195-010d97e21286 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Flavor pref 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:40:36.033265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-3fc762e1-e10d-4a5f-a195-010d97e21286 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Image pref 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:40:36.033889 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-3fc762e1-e10d-4a5f-a195-010d97e21286 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:40:36.043366 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3fc762e1-e10d-4a5f-a195-010d97e21286 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:36.044062 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3fc762e1-e10d-4a5f-a195-010d97e21286 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:36.044702 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3fc762e1-e10d-4a5f-a195-010d97e21286 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:36.045441 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3fc762e1-e10d-4a5f-a195-010d97e21286 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:36.045889 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3fc762e1-e10d-4a5f-a195-010d97e21286 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:36.046311 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3fc762e1-e10d-4a5f-a195-010d97e21286 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:36.064740 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-3fc762e1-e10d-4a5f-a195-010d97e21286 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Getting quotas for project ec5893d9a55f4ed28f6579397d0d6f21. Resources: {'ram', 'cores', 'instances'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:40:36.069342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-3fc762e1-e10d-4a5f-a195-010d97e21286 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Getting quotas for user 45422a67a78f4784abc0f18ad84778f3 and project ec5893d9a55f4ed28f6579397d0d6f21. Resources: {'ram', 'cores', 'instances'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:40:36.081913 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-3fc762e1-e10d-4a5f-a195-010d97e21286 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Going to run 1 instances... {{(pid=128049) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:40:36.084974 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-3fc762e1-e10d-4a5f-a195-010d97e21286 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12947ed8-8ca9-442d-9224-509e79a198e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:40:36.107311 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:36.168655 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-3cfefd4b-3df7-4d75-9590-cb835a1610c2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:36.176748 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-3cfefd4b-3df7-4d75-9590-cb835a1610c2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1574 microversion: 2.1 time: 0.182039 Aug 31 00:40:36.179167 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 363/735] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:35 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1574 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:36.243294 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-3fc762e1-e10d-4a5f-a195-010d97e21286 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.786087 Aug 31 00:40:36.243950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 373/736] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:40:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:40:36.255998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-940d7632-0157-4f70-a2e6-ca6153bd1cbd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:36.256840 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-940d7632-0157-4f70-a2e6-ca6153bd1cbd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:36.316841 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-940d7632-0157-4f70-a2e6-ca6153bd1cbd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:36.324727 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-940d7632-0157-4f70-a2e6-ca6153bd1cbd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1241 microversion: 2.1 time: 0.072469 Aug 31 00:40:36.326279 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 364/737] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:36 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:36.423452 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-af295161-5b19-40f6-839b-a8462eb806d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:36.424352 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-af295161-5b19-40f6-839b-a8462eb806d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:36.430771 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-af295161-5b19-40f6-839b-a8462eb806d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:36.431290 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-af295161-5b19-40f6-839b-a8462eb806d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:36.431873 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-af295161-5b19-40f6-839b-a8462eb806d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:36.432859 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-af295161-5b19-40f6-839b-a8462eb806d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:36.433487 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-af295161-5b19-40f6-839b-a8462eb806d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:36.434553 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-af295161-5b19-40f6-839b-a8462eb806d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:36.576269 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-af295161-5b19-40f6-839b-a8462eb806d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:36.597909 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-af295161-5b19-40f6-839b-a8462eb806d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:36.597909 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-af295161-5b19-40f6-839b-a8462eb806d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:36.597909 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-af295161-5b19-40f6-839b-a8462eb806d9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1726 microversion: 2.20 time: 0.177070 Aug 31 00:40:36.598276 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 374/738] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:36 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:37.014847 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9eafb4d7-4235-4eeb-a8dc-ef101d31227f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:37.015444 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9eafb4d7-4235-4eeb-a8dc-ef101d31227f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:37.021307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9eafb4d7-4235-4eeb-a8dc-ef101d31227f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:37.021783 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9eafb4d7-4235-4eeb-a8dc-ef101d31227f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:37.022207 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9eafb4d7-4235-4eeb-a8dc-ef101d31227f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:37.022906 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9eafb4d7-4235-4eeb-a8dc-ef101d31227f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:37.023308 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9eafb4d7-4235-4eeb-a8dc-ef101d31227f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:37.023723 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9eafb4d7-4235-4eeb-a8dc-ef101d31227f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:37.088185 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-9eafb4d7-4235-4eeb-a8dc-ef101d31227f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:37.096462 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9eafb4d7-4235-4eeb-a8dc-ef101d31227f tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1241 microversion: 2.1 time: 0.085501 Aug 31 00:40:37.097020 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 365/739] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:37 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:37.199561 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-dcc20d29-1e43-4817-af05-9b17265a1759 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:37.201419 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-dcc20d29-1e43-4817-af05-9b17265a1759 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:37.209375 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dcc20d29-1e43-4817-af05-9b17265a1759 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:37.209919 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dcc20d29-1e43-4817-af05-9b17265a1759 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:37.212939 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dcc20d29-1e43-4817-af05-9b17265a1759 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:37.212939 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dcc20d29-1e43-4817-af05-9b17265a1759 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:37.212939 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dcc20d29-1e43-4817-af05-9b17265a1759 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:37.212939 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dcc20d29-1e43-4817-af05-9b17265a1759 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:37.350114 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-dcc20d29-1e43-4817-af05-9b17265a1759 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:37.350732 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ae9467ca-d2c5-471b-b594-04c193875d12 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:37.351840 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ae9467ca-d2c5-471b-b594-04c193875d12 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:37.366293 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ae9467ca-d2c5-471b-b594-04c193875d12 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:37.367196 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ae9467ca-d2c5-471b-b594-04c193875d12 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:37.367943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ae9467ca-d2c5-471b-b594-04c193875d12 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:37.369210 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ae9467ca-d2c5-471b-b594-04c193875d12 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:37.370030 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ae9467ca-d2c5-471b-b594-04c193875d12 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:37.370748 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ae9467ca-d2c5-471b-b594-04c193875d12 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:37.372517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-dcc20d29-1e43-4817-af05-9b17265a1759 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1574 microversion: 2.1 time: 0.176372 Aug 31 00:40:37.373100 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 375/740] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:37 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:37.441190 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ae9467ca-d2c5-471b-b594-04c193875d12 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:37.448904 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ae9467ca-d2c5-471b-b594-04c193875d12 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1245 microversion: 2.1 time: 0.105500 Aug 31 00:40:37.450250 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 366/741] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:37 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1245 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:37.620372 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-92c1952b-bc13-4fa5-a5f6-2eac92b5b93e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:37.620980 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-92c1952b-bc13-4fa5-a5f6-2eac92b5b93e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:37.627704 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-92c1952b-bc13-4fa5-a5f6-2eac92b5b93e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:37.628189 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-92c1952b-bc13-4fa5-a5f6-2eac92b5b93e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:37.628649 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-92c1952b-bc13-4fa5-a5f6-2eac92b5b93e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:37.629350 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-92c1952b-bc13-4fa5-a5f6-2eac92b5b93e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:37.629807 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-92c1952b-bc13-4fa5-a5f6-2eac92b5b93e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:37.630300 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-92c1952b-bc13-4fa5-a5f6-2eac92b5b93e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:37.763170 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-92c1952b-bc13-4fa5-a5f6-2eac92b5b93e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:37.771378 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-92c1952b-bc13-4fa5-a5f6-2eac92b5b93e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:37.772887 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-92c1952b-bc13-4fa5-a5f6-2eac92b5b93e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:37.774082 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-92c1952b-bc13-4fa5-a5f6-2eac92b5b93e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1726 microversion: 2.20 time: 0.157793 Aug 31 00:40:37.774941 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 376/742] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:37 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:40:38.118429 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-b84e98d4-257c-4c3e-9a70-c56184d6a4ca tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:38.119172 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-b84e98d4-257c-4c3e-9a70-c56184d6a4ca tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:38.126504 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b84e98d4-257c-4c3e-9a70-c56184d6a4ca tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:38.127145 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b84e98d4-257c-4c3e-9a70-c56184d6a4ca tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:38.127592 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b84e98d4-257c-4c3e-9a70-c56184d6a4ca tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:38.128525 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b84e98d4-257c-4c3e-9a70-c56184d6a4ca tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:38.128931 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b84e98d4-257c-4c3e-9a70-c56184d6a4ca tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:38.129408 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b84e98d4-257c-4c3e-9a70-c56184d6a4ca tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:38.132606 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=100 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:38.395053 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-05748f0c-fa27-4fa1-89e6-944f525877e1 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:38.395901 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-05748f0c-fa27-4fa1-89e6-944f525877e1 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:38.404715 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-05748f0c-fa27-4fa1-89e6-944f525877e1 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:38.405306 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-05748f0c-fa27-4fa1-89e6-944f525877e1 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:38.405734 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-05748f0c-fa27-4fa1-89e6-944f525877e1 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:38.406444 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-05748f0c-fa27-4fa1-89e6-944f525877e1 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:38.406899 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-05748f0c-fa27-4fa1-89e6-944f525877e1 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:38.407356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-05748f0c-fa27-4fa1-89e6-944f525877e1 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:38.442843 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b84e98d4-257c-4c3e-9a70-c56184d6a4ca tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:38.451355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-b84e98d4-257c-4c3e-9a70-c56184d6a4ca tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1233 microversion: 2.1 time: 0.337408 Aug 31 00:40:38.452358 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 367/743] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:38 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1233 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:38.474312 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-61d68f53-8881-4fb6-a903-a84485aaadea tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:38.474914 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-61d68f53-8881-4fb6-a903-a84485aaadea tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:38.483531 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-61d68f53-8881-4fb6-a903-a84485aaadea tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:38.484110 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-61d68f53-8881-4fb6-a903-a84485aaadea tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:38.484587 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-61d68f53-8881-4fb6-a903-a84485aaadea tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:38.485296 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-61d68f53-8881-4fb6-a903-a84485aaadea tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:38.485742 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-61d68f53-8881-4fb6-a903-a84485aaadea tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:38.486161 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-61d68f53-8881-4fb6-a903-a84485aaadea tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:38.552806 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-61d68f53-8881-4fb6-a903-a84485aaadea tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:38.561260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-05748f0c-fa27-4fa1-89e6-944f525877e1 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:38.562597 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-61d68f53-8881-4fb6-a903-a84485aaadea tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1237 microversion: 2.1 time: 0.092412 Aug 31 00:40:38.563393 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 368/744] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:38 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1237 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:38.569613 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-05748f0c-fa27-4fa1-89e6-944f525877e1 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1574 microversion: 2.1 time: 0.178848 Aug 31 00:40:38.570373 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 377/745] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:38 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1574 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:38.802933 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-60afe5b1-7d47-4d43-87fc-14d90860351c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:38.803317 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-60afe5b1-7d47-4d43-87fc-14d90860351c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:38.810595 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-60afe5b1-7d47-4d43-87fc-14d90860351c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:38.814909 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-60afe5b1-7d47-4d43-87fc-14d90860351c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:38.814909 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-60afe5b1-7d47-4d43-87fc-14d90860351c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:38.814909 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-60afe5b1-7d47-4d43-87fc-14d90860351c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:38.814909 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-60afe5b1-7d47-4d43-87fc-14d90860351c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:38.815472 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-60afe5b1-7d47-4d43-87fc-14d90860351c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:38.954330 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-60afe5b1-7d47-4d43-87fc-14d90860351c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:38.962646 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-60afe5b1-7d47-4d43-87fc-14d90860351c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:38.964356 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-60afe5b1-7d47-4d43-87fc-14d90860351c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:38.965532 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-60afe5b1-7d47-4d43-87fc-14d90860351c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1726 microversion: 2.20 time: 0.167086 Aug 31 00:40:38.966094 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 369/746] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:38 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:39.476276 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-772bdc50-50ce-4abc-8b41-0e6de27167ec tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:39.476912 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-772bdc50-50ce-4abc-8b41-0e6de27167ec tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:39.484392 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-772bdc50-50ce-4abc-8b41-0e6de27167ec tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:39.484945 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-772bdc50-50ce-4abc-8b41-0e6de27167ec tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:39.485523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-772bdc50-50ce-4abc-8b41-0e6de27167ec tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:39.486224 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-772bdc50-50ce-4abc-8b41-0e6de27167ec tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:39.486761 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-772bdc50-50ce-4abc-8b41-0e6de27167ec tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:39.487367 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-772bdc50-50ce-4abc-8b41-0e6de27167ec tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:39.554115 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-772bdc50-50ce-4abc-8b41-0e6de27167ec tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:39.562615 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-772bdc50-50ce-4abc-8b41-0e6de27167ec tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1297 microversion: 2.1 time: 0.090439 Aug 31 00:40:39.563196 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 378/747] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:39 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:39.584739 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-62b7e81d-7a91-4996-8009-7fc4b9cfb1c2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:39.585637 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-62b7e81d-7a91-4996-8009-7fc4b9cfb1c2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:39.593023 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-62b7e81d-7a91-4996-8009-7fc4b9cfb1c2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:39.593789 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-62b7e81d-7a91-4996-8009-7fc4b9cfb1c2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:39.594382 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-62b7e81d-7a91-4996-8009-7fc4b9cfb1c2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:39.595418 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c4dc294a-17d9-4f33-84b3-c1105a2440a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:39.595853 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-62b7e81d-7a91-4996-8009-7fc4b9cfb1c2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:39.596489 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-62b7e81d-7a91-4996-8009-7fc4b9cfb1c2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:39.596830 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c4dc294a-17d9-4f33-84b3-c1105a2440a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:39.597229 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-62b7e81d-7a91-4996-8009-7fc4b9cfb1c2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:39.607394 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c4dc294a-17d9-4f33-84b3-c1105a2440a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:39.608341 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c4dc294a-17d9-4f33-84b3-c1105a2440a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:39.608907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c4dc294a-17d9-4f33-84b3-c1105a2440a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:39.609727 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c4dc294a-17d9-4f33-84b3-c1105a2440a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:39.610287 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c4dc294a-17d9-4f33-84b3-c1105a2440a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:39.611010 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c4dc294a-17d9-4f33-84b3-c1105a2440a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:39.680153 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-62b7e81d-7a91-4996-8009-7fc4b9cfb1c2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:39.688943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-62b7e81d-7a91-4996-8009-7fc4b9cfb1c2 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1293 microversion: 2.1 time: 0.108083 Aug 31 00:40:39.689528 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 370/748] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:39 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1293 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:39.880616 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-c4dc294a-17d9-4f33-84b3-c1105a2440a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:39.892744 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c4dc294a-17d9-4f33-84b3-c1105a2440a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1574 microversion: 2.1 time: 0.305235 Aug 31 00:40:39.893869 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 379/749] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:39 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1574 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:39.996968 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-3fcf9694-fb1d-4025-a516-48061e8a6c77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:39.998276 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-3fcf9694-fb1d-4025-a516-48061e8a6c77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:40.007670 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3fcf9694-fb1d-4025-a516-48061e8a6c77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:40.008645 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3fcf9694-fb1d-4025-a516-48061e8a6c77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:40.009410 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3fcf9694-fb1d-4025-a516-48061e8a6c77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:40.010443 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3fcf9694-fb1d-4025-a516-48061e8a6c77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:40.011265 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3fcf9694-fb1d-4025-a516-48061e8a6c77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:40.011925 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3fcf9694-fb1d-4025-a516-48061e8a6c77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:40.294242 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-3fcf9694-fb1d-4025-a516-48061e8a6c77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:40.315710 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-3fcf9694-fb1d-4025-a516-48061e8a6c77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:40.318578 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-3fcf9694-fb1d-4025-a516-48061e8a6c77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:40.320791 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-3fcf9694-fb1d-4025-a516-48061e8a6c77 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1726 microversion: 2.20 time: 0.334677 Aug 31 00:40:40.321788 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 371/750] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:39 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1726 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:40.593704 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3fae1c4d-cd4c-4bf8-a8d0-e700aa408e6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:40.594963 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-3fae1c4d-cd4c-4bf8-a8d0-e700aa408e6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:40.601587 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3fae1c4d-cd4c-4bf8-a8d0-e700aa408e6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:40.602375 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3fae1c4d-cd4c-4bf8-a8d0-e700aa408e6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:40.603857 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3fae1c4d-cd4c-4bf8-a8d0-e700aa408e6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:40.604971 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3fae1c4d-cd4c-4bf8-a8d0-e700aa408e6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:40.605603 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3fae1c4d-cd4c-4bf8-a8d0-e700aa408e6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:40.606203 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3fae1c4d-cd4c-4bf8-a8d0-e700aa408e6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:40.701508 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-3fae1c4d-cd4c-4bf8-a8d0-e700aa408e6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:40.713347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-724e9d13-1bf0-4a94-b837-bbf7a0b41818 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:40.714029 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-3fae1c4d-cd4c-4bf8-a8d0-e700aa408e6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1295 microversion: 2.1 time: 0.129482 Aug 31 00:40:40.714755 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-724e9d13-1bf0-4a94-b837-bbf7a0b41818 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:40.723953 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-724e9d13-1bf0-4a94-b837-bbf7a0b41818 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:40.725782 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-724e9d13-1bf0-4a94-b837-bbf7a0b41818 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:40.726479 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-724e9d13-1bf0-4a94-b837-bbf7a0b41818 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:40.727643 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-724e9d13-1bf0-4a94-b837-bbf7a0b41818 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:40.728318 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-724e9d13-1bf0-4a94-b837-bbf7a0b41818 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:40.729014 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-724e9d13-1bf0-4a94-b837-bbf7a0b41818 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:40.729808 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 380/751] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:40 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1295 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:40.833719 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-724e9d13-1bf0-4a94-b837-bbf7a0b41818 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:40.847450 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-724e9d13-1bf0-4a94-b837-bbf7a0b41818 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1299 microversion: 2.1 time: 0.138997 Aug 31 00:40:40.848268 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 372/752] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:40 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1299 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:40.917606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-67bddbac-538e-409b-8fde-31d5f9c515d8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:40.918326 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-67bddbac-538e-409b-8fde-31d5f9c515d8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:40.926304 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-67bddbac-538e-409b-8fde-31d5f9c515d8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:40.927881 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-67bddbac-538e-409b-8fde-31d5f9c515d8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:40.928865 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-67bddbac-538e-409b-8fde-31d5f9c515d8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:40.930339 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-67bddbac-538e-409b-8fde-31d5f9c515d8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:40.931582 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-67bddbac-538e-409b-8fde-31d5f9c515d8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:40.932882 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-67bddbac-538e-409b-8fde-31d5f9c515d8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:41.198925 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-67bddbac-538e-409b-8fde-31d5f9c515d8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:41.239008 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-67bddbac-538e-409b-8fde-31d5f9c515d8 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1574 microversion: 2.1 time: 0.323901 Aug 31 00:40:41.250615 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 381/753] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:40 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1574 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:41.347365 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-e513f364-06a5-47fb-b3e5-597204498600 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:41.348052 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-e513f364-06a5-47fb-b3e5-597204498600 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:41.362693 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e513f364-06a5-47fb-b3e5-597204498600 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:41.363844 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e513f364-06a5-47fb-b3e5-597204498600 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:41.365985 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e513f364-06a5-47fb-b3e5-597204498600 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:41.366713 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e513f364-06a5-47fb-b3e5-597204498600 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:41.367166 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e513f364-06a5-47fb-b3e5-597204498600 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:41.367577 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e513f364-06a5-47fb-b3e5-597204498600 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:41.589796 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-e513f364-06a5-47fb-b3e5-597204498600 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:41.600029 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-e513f364-06a5-47fb-b3e5-597204498600 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:41.601987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-e513f364-06a5-47fb-b3e5-597204498600 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:41.604550 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-e513f364-06a5-47fb-b3e5-597204498600 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1726 microversion: 2.20 time: 0.263494 Aug 31 00:40:41.605799 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 373/754] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:41 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1726 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:41.741089 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-be8632e4-10ca-41d3-895d-cb57d44625fc tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:41.741709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-be8632e4-10ca-41d3-895d-cb57d44625fc tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:41.751231 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-be8632e4-10ca-41d3-895d-cb57d44625fc tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:41.752093 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-be8632e4-10ca-41d3-895d-cb57d44625fc tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:41.752768 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-be8632e4-10ca-41d3-895d-cb57d44625fc tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:41.753659 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-be8632e4-10ca-41d3-895d-cb57d44625fc tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:41.754354 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-be8632e4-10ca-41d3-895d-cb57d44625fc tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:41.754908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-be8632e4-10ca-41d3-895d-cb57d44625fc tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:41.873323 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ee57b691-8d37-404a-9be9-12c04e60a1e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:41.874319 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ee57b691-8d37-404a-9be9-12c04e60a1e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:41.889475 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ee57b691-8d37-404a-9be9-12c04e60a1e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:41.890115 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ee57b691-8d37-404a-9be9-12c04e60a1e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:41.891435 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ee57b691-8d37-404a-9be9-12c04e60a1e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:41.892238 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ee57b691-8d37-404a-9be9-12c04e60a1e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:41.892974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ee57b691-8d37-404a-9be9-12c04e60a1e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:41.893501 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ee57b691-8d37-404a-9be9-12c04e60a1e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:42.002828 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-be8632e4-10ca-41d3-895d-cb57d44625fc tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:42.036483 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-be8632e4-10ca-41d3-895d-cb57d44625fc tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1363 microversion: 2.1 time: 0.300569 Aug 31 00:40:42.038574 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 382/755] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:41 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:42.135367 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-2eabdf83-b85a-4be6-98ea-7b7de351352d req-0f638293-aeca-4a32-bed8-2a146bdc53dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf8cd0c7-4af8-443b-9f8d-d878cc6137e7", "tag": "a5078607-db3e-4a97-b7ea-6ced696b1877"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:42.147446 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-2eabdf83-b85a-4be6-98ea-7b7de351352d req-0f638293-aeca-4a32-bed8-2a146bdc53dc service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:42.148672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-2eabdf83-b85a-4be6-98ea-7b7de351352d req-0f638293-aeca-4a32-bed8-2a146bdc53dc service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:42.149585 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-2eabdf83-b85a-4be6-98ea-7b7de351352d req-0f638293-aeca-4a32-bed8-2a146bdc53dc service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:42.163272 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-2eabdf83-b85a-4be6-98ea-7b7de351352d req-0f638293-aeca-4a32-bed8-2a146bdc53dc service nova] Creating event network-changed:a5078607-db3e-4a97-b7ea-6ced696b1877 for instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 on hv-cinder-85221 Aug 31 00:40:42.170143 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-2eabdf83-b85a-4be6-98ea-7b7de351352d req-0f638293-aeca-4a32-bed8-2a146bdc53dc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037749 Aug 31 00:40:42.171621 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 383/756] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:42.227293 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ee57b691-8d37-404a-9be9-12c04e60a1e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:42.251238 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ee57b691-8d37-404a-9be9-12c04e60a1e7 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1367 microversion: 2.1 time: 0.382807 Aug 31 00:40:42.265349 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 374/757] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:41 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1367 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:42.284308 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-463cf7e0-c332-4330-a176-4333573c0731 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:42.284962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-463cf7e0-c332-4330-a176-4333573c0731 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:42.300013 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-463cf7e0-c332-4330-a176-4333573c0731 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:42.300506 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-463cf7e0-c332-4330-a176-4333573c0731 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:42.300959 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-463cf7e0-c332-4330-a176-4333573c0731 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:42.302428 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-463cf7e0-c332-4330-a176-4333573c0731 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:42.302870 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-463cf7e0-c332-4330-a176-4333573c0731 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:42.305434 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-463cf7e0-c332-4330-a176-4333573c0731 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:42.440544 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-72cc4b11-8b76-4765-bae6-6b32b0bfaff5 req-4bf4a239-0df0-4055-b16b-7620e0da4416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce65669-d807-40a9-95e1-8cb85a0f03c3", "name": "network-vif-plugged", "status": "completed", "tag": "c18f4b3c-fb43-40d2-901a-6255ea8c3f61"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:42.460659 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-72cc4b11-8b76-4765-bae6-6b32b0bfaff5 req-4bf4a239-0df0-4055-b16b-7620e0da4416 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:42.461138 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-72cc4b11-8b76-4765-bae6-6b32b0bfaff5 req-4bf4a239-0df0-4055-b16b-7620e0da4416 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:42.461566 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-72cc4b11-8b76-4765-bae6-6b32b0bfaff5 req-4bf4a239-0df0-4055-b16b-7620e0da4416 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:42.465243 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=100 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:42.496655 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-72cc4b11-8b76-4765-bae6-6b32b0bfaff5 req-4bf4a239-0df0-4055-b16b-7620e0da4416 service nova] Creating event network-vif-plugged:c18f4b3c-fb43-40d2-901a-6255ea8c3f61 for instance bce65669-d807-40a9-95e1-8cb85a0f03c3 on hv-cinder-85221 Aug 31 00:40:42.506866 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-72cc4b11-8b76-4765-bae6-6b32b0bfaff5 req-4bf4a239-0df0-4055-b16b-7620e0da4416 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.258188 Aug 31 00:40:42.507846 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 384/758] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:42.526488 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-a23cd3f7-f1a2-4788-9951-499b9c9cf97b req-d5937da8-e343-4c3b-a16d-ee2d72a029bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50bd32a4-8af1-4f25-b417-e99467180ff3", "tag": "68a3ba26-0475-4d94-9656-0d4d923ff6d1"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:42.541822 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-a23cd3f7-f1a2-4788-9951-499b9c9cf97b req-d5937da8-e343-4c3b-a16d-ee2d72a029bd service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:42.542379 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-a23cd3f7-f1a2-4788-9951-499b9c9cf97b req-d5937da8-e343-4c3b-a16d-ee2d72a029bd service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:42.543446 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-a23cd3f7-f1a2-4788-9951-499b9c9cf97b req-d5937da8-e343-4c3b-a16d-ee2d72a029bd service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:42.557912 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-a23cd3f7-f1a2-4788-9951-499b9c9cf97b req-d5937da8-e343-4c3b-a16d-ee2d72a029bd service nova] Creating event network-changed:68a3ba26-0475-4d94-9656-0d4d923ff6d1 for instance 50bd32a4-8af1-4f25-b417-e99467180ff3 on hv-cinder-85221 Aug 31 00:40:42.564443 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-a23cd3f7-f1a2-4788-9951-499b9c9cf97b req-d5937da8-e343-4c3b-a16d-ee2d72a029bd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044497 Aug 31 00:40:42.569130 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-463cf7e0-c332-4330-a176-4333573c0731 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:42.578601 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-463cf7e0-c332-4330-a176-4333573c0731 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1574 microversion: 2.1 time: 0.307775 Aug 31 00:40:42.578823 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 385/759] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:42.579460 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 375/760] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:42 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1574 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:42.643578 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8b0b4754-d4e2-4027-bf15-ee28ece10e0d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:42.644211 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8b0b4754-d4e2-4027-bf15-ee28ece10e0d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:42.650922 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b0b4754-d4e2-4027-bf15-ee28ece10e0d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:42.651406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b0b4754-d4e2-4027-bf15-ee28ece10e0d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:42.651836 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b0b4754-d4e2-4027-bf15-ee28ece10e0d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:42.652610 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b0b4754-d4e2-4027-bf15-ee28ece10e0d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:42.652998 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b0b4754-d4e2-4027-bf15-ee28ece10e0d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:42.653415 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b0b4754-d4e2-4027-bf15-ee28ece10e0d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:42.963918 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8b0b4754-d4e2-4027-bf15-ee28ece10e0d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:42.979155 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8b0b4754-d4e2-4027-bf15-ee28ece10e0d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:42.981515 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8b0b4754-d4e2-4027-bf15-ee28ece10e0d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:42.983888 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8b0b4754-d4e2-4027-bf15-ee28ece10e0d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1726 microversion: 2.20 time: 0.356507 Aug 31 00:40:42.984472 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 386/761] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:42 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1726 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:43.064241 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-fcc1dd6d-4213-4a8a-a17d-27b76ea1c5b1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:43.064887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-fcc1dd6d-4213-4a8a-a17d-27b76ea1c5b1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:43.071529 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fcc1dd6d-4213-4a8a-a17d-27b76ea1c5b1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:43.076637 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fcc1dd6d-4213-4a8a-a17d-27b76ea1c5b1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:43.076637 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fcc1dd6d-4213-4a8a-a17d-27b76ea1c5b1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:43.076637 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fcc1dd6d-4213-4a8a-a17d-27b76ea1c5b1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:43.076637 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fcc1dd6d-4213-4a8a-a17d-27b76ea1c5b1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:43.077548 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fcc1dd6d-4213-4a8a-a17d-27b76ea1c5b1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:43.278576 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-acb1e217-9753-4d65-9bb0-6e3be8316b6d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:43.278576 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-acb1e217-9753-4d65-9bb0-6e3be8316b6d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:43.278756 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fcc1dd6d-4213-4a8a-a17d-27b76ea1c5b1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:43.280609 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-acb1e217-9753-4d65-9bb0-6e3be8316b6d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:43.282150 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-acb1e217-9753-4d65-9bb0-6e3be8316b6d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:43.282150 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-acb1e217-9753-4d65-9bb0-6e3be8316b6d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:43.283766 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-acb1e217-9753-4d65-9bb0-6e3be8316b6d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:43.284217 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-acb1e217-9753-4d65-9bb0-6e3be8316b6d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:43.284662 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-acb1e217-9753-4d65-9bb0-6e3be8316b6d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:43.284923 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-fcc1dd6d-4213-4a8a-a17d-27b76ea1c5b1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1363 microversion: 2.1 time: 0.225303 Aug 31 00:40:43.299985 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 376/762] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:43 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:43.426593 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-acb1e217-9753-4d65-9bb0-6e3be8316b6d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:43.434747 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-acb1e217-9753-4d65-9bb0-6e3be8316b6d tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1367 microversion: 2.1 time: 0.165994 Aug 31 00:40:43.436091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 387/763] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:43 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:43.601414 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-e5d4b783-d2eb-4aa6-b08f-4c353d3c4b07 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:43.602016 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-e5d4b783-d2eb-4aa6-b08f-4c353d3c4b07 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:43.608810 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e5d4b783-d2eb-4aa6-b08f-4c353d3c4b07 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:43.610075 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e5d4b783-d2eb-4aa6-b08f-4c353d3c4b07 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:43.610525 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e5d4b783-d2eb-4aa6-b08f-4c353d3c4b07 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:43.611283 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e5d4b783-d2eb-4aa6-b08f-4c353d3c4b07 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:43.611726 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e5d4b783-d2eb-4aa6-b08f-4c353d3c4b07 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:43.612147 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e5d4b783-d2eb-4aa6-b08f-4c353d3c4b07 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:43.780439 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-e5d4b783-d2eb-4aa6-b08f-4c353d3c4b07 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:43.794029 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-e5d4b783-d2eb-4aa6-b08f-4c353d3c4b07 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1574 microversion: 2.1 time: 0.196513 Aug 31 00:40:43.794609 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 377/764] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:43 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1574 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:44.008115 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-48c934f9-e89b-4fc0-9e2c-7d8ec95c601d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:44.008704 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-48c934f9-e89b-4fc0-9e2c-7d8ec95c601d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:44.015834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-48c934f9-e89b-4fc0-9e2c-7d8ec95c601d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:44.016379 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-48c934f9-e89b-4fc0-9e2c-7d8ec95c601d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:44.016824 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-48c934f9-e89b-4fc0-9e2c-7d8ec95c601d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:44.017524 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-48c934f9-e89b-4fc0-9e2c-7d8ec95c601d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:44.018065 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-48c934f9-e89b-4fc0-9e2c-7d8ec95c601d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:44.018488 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-48c934f9-e89b-4fc0-9e2c-7d8ec95c601d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:44.198960 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-48c934f9-e89b-4fc0-9e2c-7d8ec95c601d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:44.209747 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-48c934f9-e89b-4fc0-9e2c-7d8ec95c601d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:44.212248 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-48c934f9-e89b-4fc0-9e2c-7d8ec95c601d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:44.213882 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-48c934f9-e89b-4fc0-9e2c-7d8ec95c601d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1747 microversion: 2.20 time: 0.209819 Aug 31 00:40:44.215006 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 388/765] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:44 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1747 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:44.307192 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-aba42bcf-4bd9-4700-a91f-8f09d37683b7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:44.307751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-aba42bcf-4bd9-4700-a91f-8f09d37683b7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:44.314741 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aba42bcf-4bd9-4700-a91f-8f09d37683b7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:44.315230 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aba42bcf-4bd9-4700-a91f-8f09d37683b7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:44.315702 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aba42bcf-4bd9-4700-a91f-8f09d37683b7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:44.316814 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aba42bcf-4bd9-4700-a91f-8f09d37683b7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:44.317438 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aba42bcf-4bd9-4700-a91f-8f09d37683b7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:44.317867 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-aba42bcf-4bd9-4700-a91f-8f09d37683b7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:44.456878 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8aa8f04d-db28-4f43-b122-1604f61c73b5 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:44.457485 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8aa8f04d-db28-4f43-b122-1604f61c73b5 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:44.463731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8aa8f04d-db28-4f43-b122-1604f61c73b5 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:44.464215 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8aa8f04d-db28-4f43-b122-1604f61c73b5 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:44.464737 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8aa8f04d-db28-4f43-b122-1604f61c73b5 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:44.465436 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8aa8f04d-db28-4f43-b122-1604f61c73b5 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:44.465931 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8aa8f04d-db28-4f43-b122-1604f61c73b5 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:44.466354 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8aa8f04d-db28-4f43-b122-1604f61c73b5 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:44.477615 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-aba42bcf-4bd9-4700-a91f-8f09d37683b7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:44.479151 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-aba42bcf-4bd9-4700-a91f-8f09d37683b7 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1363 microversion: 2.1 time: 0.176108 Aug 31 00:40:44.479725 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 378/766] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:44 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:44.622068 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8aa8f04d-db28-4f43-b122-1604f61c73b5 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:44.630309 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8aa8f04d-db28-4f43-b122-1604f61c73b5 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1367 microversion: 2.1 time: 0.177572 Aug 31 00:40:44.630870 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 389/767] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:44 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:44.817491 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d436bcdd-2815-48ac-96da-737ef1098798 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:44.818042 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d436bcdd-2815-48ac-96da-737ef1098798 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:44.824234 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d436bcdd-2815-48ac-96da-737ef1098798 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:44.824760 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d436bcdd-2815-48ac-96da-737ef1098798 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:44.825196 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d436bcdd-2815-48ac-96da-737ef1098798 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:44.825882 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d436bcdd-2815-48ac-96da-737ef1098798 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:44.826906 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d436bcdd-2815-48ac-96da-737ef1098798 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:44.827333 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d436bcdd-2815-48ac-96da-737ef1098798 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:44.971633 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d436bcdd-2815-48ac-96da-737ef1098798 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:44.980619 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d436bcdd-2815-48ac-96da-737ef1098798 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1574 microversion: 2.1 time: 0.167640 Aug 31 00:40:44.995970 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 379/768] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:44 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1574 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:45.240172 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-273b3d58-d8f5-4f9e-af33-0fba2a6f6ac7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:45.240825 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-273b3d58-d8f5-4f9e-af33-0fba2a6f6ac7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:45.247552 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-273b3d58-d8f5-4f9e-af33-0fba2a6f6ac7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:45.248033 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-273b3d58-d8f5-4f9e-af33-0fba2a6f6ac7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:45.248490 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-273b3d58-d8f5-4f9e-af33-0fba2a6f6ac7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:45.249177 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-273b3d58-d8f5-4f9e-af33-0fba2a6f6ac7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:45.249740 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-273b3d58-d8f5-4f9e-af33-0fba2a6f6ac7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:45.250032 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-273b3d58-d8f5-4f9e-af33-0fba2a6f6ac7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:45.390484 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-273b3d58-d8f5-4f9e-af33-0fba2a6f6ac7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:45.399613 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-273b3d58-d8f5-4f9e-af33-0fba2a6f6ac7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:45.401097 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-273b3d58-d8f5-4f9e-af33-0fba2a6f6ac7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:45.402276 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-273b3d58-d8f5-4f9e-af33-0fba2a6f6ac7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1747 microversion: 2.20 time: 0.166432 Aug 31 00:40:45.402834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 390/769] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:45 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1747 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:40:45.501008 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ad4b3045-da51-4b5c-a7b5-49d7f5bfa2b8 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:45.501713 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ad4b3045-da51-4b5c-a7b5-49d7f5bfa2b8 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:45.505861 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:45.510288 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ad4b3045-da51-4b5c-a7b5-49d7f5bfa2b8 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:45.510288 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ad4b3045-da51-4b5c-a7b5-49d7f5bfa2b8 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:45.510511 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ad4b3045-da51-4b5c-a7b5-49d7f5bfa2b8 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:45.511199 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ad4b3045-da51-4b5c-a7b5-49d7f5bfa2b8 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:45.511654 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ad4b3045-da51-4b5c-a7b5-49d7f5bfa2b8 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:45.512152 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ad4b3045-da51-4b5c-a7b5-49d7f5bfa2b8 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:45.652637 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-543703d9-95cf-4733-a7b1-fd088fcd5df8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:45.653396 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-543703d9-95cf-4733-a7b1-fd088fcd5df8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:45.662351 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-543703d9-95cf-4733-a7b1-fd088fcd5df8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:45.662734 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-543703d9-95cf-4733-a7b1-fd088fcd5df8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:45.663226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-543703d9-95cf-4733-a7b1-fd088fcd5df8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:45.663485 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ad4b3045-da51-4b5c-a7b5-49d7f5bfa2b8 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:45.664168 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-543703d9-95cf-4733-a7b1-fd088fcd5df8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:45.664681 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-543703d9-95cf-4733-a7b1-fd088fcd5df8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:45.665095 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-543703d9-95cf-4733-a7b1-fd088fcd5df8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:45.675293 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ad4b3045-da51-4b5c-a7b5-49d7f5bfa2b8 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1363 microversion: 2.1 time: 0.178445 Aug 31 00:40:45.676036 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 380/770] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:45 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:45.809104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-543703d9-95cf-4733-a7b1-fd088fcd5df8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:45.817311 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-543703d9-95cf-4733-a7b1-fd088fcd5df8 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1367 microversion: 2.1 time: 0.169120 Aug 31 00:40:45.817910 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 391/771] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:45 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:46.003122 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-56f65280-3c30-43dc-af47-4c0b335c3c8e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:46.003728 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-56f65280-3c30-43dc-af47-4c0b335c3c8e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:46.005959 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:46.011118 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-56f65280-3c30-43dc-af47-4c0b335c3c8e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:46.011596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-56f65280-3c30-43dc-af47-4c0b335c3c8e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:46.012024 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-56f65280-3c30-43dc-af47-4c0b335c3c8e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:46.012808 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-56f65280-3c30-43dc-af47-4c0b335c3c8e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:46.013254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-56f65280-3c30-43dc-af47-4c0b335c3c8e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:46.013944 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-56f65280-3c30-43dc-af47-4c0b335c3c8e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:46.171432 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-56f65280-3c30-43dc-af47-4c0b335c3c8e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:46.179396 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-56f65280-3c30-43dc-af47-4c0b335c3c8e tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1561 microversion: 2.1 time: 0.180158 Aug 31 00:40:46.179970 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 381/772] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:45 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:46.428848 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0038730b-f1fe-42f4-b998-cfc444828921 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:46.429439 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-0038730b-f1fe-42f4-b998-cfc444828921 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:46.431442 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=2 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:46.432118 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=10 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:46.438137 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0038730b-f1fe-42f4-b998-cfc444828921 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:46.438621 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0038730b-f1fe-42f4-b998-cfc444828921 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:46.439086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0038730b-f1fe-42f4-b998-cfc444828921 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:46.439802 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0038730b-f1fe-42f4-b998-cfc444828921 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:46.440252 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0038730b-f1fe-42f4-b998-cfc444828921 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:46.440720 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0038730b-f1fe-42f4-b998-cfc444828921 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:46.581024 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-0038730b-f1fe-42f4-b998-cfc444828921 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:46.589589 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-0038730b-f1fe-42f4-b998-cfc444828921 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:46.591037 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-0038730b-f1fe-42f4-b998-cfc444828921 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:46.593348 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-0038730b-f1fe-42f4-b998-cfc444828921 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1747 microversion: 2.20 time: 0.168286 Aug 31 00:40:46.594272 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 392/773] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:46 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1747 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:46.729358 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9d6d59dd-c123-4a61-8004-a86e057b3d12 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:46.729968 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9d6d59dd-c123-4a61-8004-a86e057b3d12 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:46.731880 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=14 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:46.737950 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9d6d59dd-c123-4a61-8004-a86e057b3d12 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:46.738437 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9d6d59dd-c123-4a61-8004-a86e057b3d12 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:46.738878 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9d6d59dd-c123-4a61-8004-a86e057b3d12 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:46.739574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9d6d59dd-c123-4a61-8004-a86e057b3d12 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:46.740027 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9d6d59dd-c123-4a61-8004-a86e057b3d12 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:46.740488 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9d6d59dd-c123-4a61-8004-a86e057b3d12 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:46.842543 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-315c5523-a1a4-4171-9224-6e9f14971679 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:46.843963 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-315c5523-a1a4-4171-9224-6e9f14971679 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:46.852833 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-315c5523-a1a4-4171-9224-6e9f14971679 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:46.855233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-315c5523-a1a4-4171-9224-6e9f14971679 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:46.857388 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-315c5523-a1a4-4171-9224-6e9f14971679 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:46.857388 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-315c5523-a1a4-4171-9224-6e9f14971679 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:46.857388 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-315c5523-a1a4-4171-9224-6e9f14971679 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:46.857388 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-315c5523-a1a4-4171-9224-6e9f14971679 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:46.883503 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-9d6d59dd-c123-4a61-8004-a86e057b3d12 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:46.892367 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9d6d59dd-c123-4a61-8004-a86e057b3d12 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1363 microversion: 2.1 time: 0.166716 Aug 31 00:40:46.892956 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 382/774] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:46 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:46.999311 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-315c5523-a1a4-4171-9224-6e9f14971679 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:47.007041 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-315c5523-a1a4-4171-9224-6e9f14971679 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1367 microversion: 2.1 time: 0.171289 Aug 31 00:40:47.007603 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 393/775] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:46 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:47.617988 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ba63c9b4-8047-4719-b154-f35301c95173 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:47.618683 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ba63c9b4-8047-4719-b154-f35301c95173 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:47.625494 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ba63c9b4-8047-4719-b154-f35301c95173 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:47.625976 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ba63c9b4-8047-4719-b154-f35301c95173 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:47.626410 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ba63c9b4-8047-4719-b154-f35301c95173 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:47.627130 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ba63c9b4-8047-4719-b154-f35301c95173 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:47.627569 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ba63c9b4-8047-4719-b154-f35301c95173 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:47.627991 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ba63c9b4-8047-4719-b154-f35301c95173 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:47.768262 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ba63c9b4-8047-4719-b154-f35301c95173 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:47.770485 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=100 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:47.777508 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ba63c9b4-8047-4719-b154-f35301c95173 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:47.778951 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ba63c9b4-8047-4719-b154-f35301c95173 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:47.780146 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ba63c9b4-8047-4719-b154-f35301c95173 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1747 microversion: 2.20 time: 0.166769 Aug 31 00:40:47.780734 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 383/776] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:47 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1747 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:47.914013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f23d50f6-237e-4332-a661-8d0357539696 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:47.914559 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f23d50f6-237e-4332-a661-8d0357539696 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:47.921155 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f23d50f6-237e-4332-a661-8d0357539696 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:47.921642 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f23d50f6-237e-4332-a661-8d0357539696 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:47.922078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f23d50f6-237e-4332-a661-8d0357539696 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:47.922773 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f23d50f6-237e-4332-a661-8d0357539696 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:47.923224 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f23d50f6-237e-4332-a661-8d0357539696 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:47.923669 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f23d50f6-237e-4332-a661-8d0357539696 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:48.030224 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-e2cae952-5843-43e8-b119-a26cecfd791f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:48.030836 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-e2cae952-5843-43e8-b119-a26cecfd791f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:48.036939 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e2cae952-5843-43e8-b119-a26cecfd791f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:48.037424 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e2cae952-5843-43e8-b119-a26cecfd791f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:48.037855 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e2cae952-5843-43e8-b119-a26cecfd791f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:48.038587 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e2cae952-5843-43e8-b119-a26cecfd791f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:48.039039 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e2cae952-5843-43e8-b119-a26cecfd791f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:48.039462 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e2cae952-5843-43e8-b119-a26cecfd791f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:48.063302 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f23d50f6-237e-4332-a661-8d0357539696 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:48.071634 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f23d50f6-237e-4332-a661-8d0357539696 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1363 microversion: 2.1 time: 0.161607 Aug 31 00:40:48.072216 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 394/777] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:47 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:48.172665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-e2cae952-5843-43e8-b119-a26cecfd791f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:48.180696 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-e2cae952-5843-43e8-b119-a26cecfd791f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1367 microversion: 2.1 time: 0.156084 Aug 31 00:40:48.181477 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 384/778] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:48 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:48.805234 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b68b7e77-ae0e-404f-a68e-ce60a36b31c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:48.805866 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-b68b7e77-ae0e-404f-a68e-ce60a36b31c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:48.812356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b68b7e77-ae0e-404f-a68e-ce60a36b31c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:48.812994 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b68b7e77-ae0e-404f-a68e-ce60a36b31c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:48.813426 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b68b7e77-ae0e-404f-a68e-ce60a36b31c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:48.814125 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b68b7e77-ae0e-404f-a68e-ce60a36b31c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:48.814568 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b68b7e77-ae0e-404f-a68e-ce60a36b31c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:48.814987 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b68b7e77-ae0e-404f-a68e-ce60a36b31c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:48.965243 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-b68b7e77-ae0e-404f-a68e-ce60a36b31c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:48.973652 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-b68b7e77-ae0e-404f-a68e-ce60a36b31c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:48.975104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-b68b7e77-ae0e-404f-a68e-ce60a36b31c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:48.976305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-b68b7e77-ae0e-404f-a68e-ce60a36b31c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1747 microversion: 2.20 time: 0.176076 Aug 31 00:40:48.976954 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 395/779] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:48 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1747 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:49.095639 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-418845e9-4919-405f-bc6c-346d9cfb9fa3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:49.096268 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-418845e9-4919-405f-bc6c-346d9cfb9fa3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:49.102916 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-418845e9-4919-405f-bc6c-346d9cfb9fa3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:49.103394 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-418845e9-4919-405f-bc6c-346d9cfb9fa3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:49.103830 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-418845e9-4919-405f-bc6c-346d9cfb9fa3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:49.104557 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-418845e9-4919-405f-bc6c-346d9cfb9fa3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:49.105003 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-418845e9-4919-405f-bc6c-346d9cfb9fa3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:49.105418 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-418845e9-4919-405f-bc6c-346d9cfb9fa3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:49.202790 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-590721df-f1b8-4542-baff-c91dc269df7a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:49.203568 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-590721df-f1b8-4542-baff-c91dc269df7a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:49.211783 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-590721df-f1b8-4542-baff-c91dc269df7a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:49.212399 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-590721df-f1b8-4542-baff-c91dc269df7a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:49.212931 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-590721df-f1b8-4542-baff-c91dc269df7a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:49.213851 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-590721df-f1b8-4542-baff-c91dc269df7a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:49.214308 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-590721df-f1b8-4542-baff-c91dc269df7a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:49.214819 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-590721df-f1b8-4542-baff-c91dc269df7a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:49.251563 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-418845e9-4919-405f-bc6c-346d9cfb9fa3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:49.262019 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-418845e9-4919-405f-bc6c-346d9cfb9fa3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1363 microversion: 2.1 time: 0.170240 Aug 31 00:40:49.262974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 385/780] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:49 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:49.377764 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-590721df-f1b8-4542-baff-c91dc269df7a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:49.386621 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-590721df-f1b8-4542-baff-c91dc269df7a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1367 microversion: 2.1 time: 0.188688 Aug 31 00:40:49.387212 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 396/781] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:49 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:50.002306 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-fc60ee99-1908-42ff-8ddc-3156e75035ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:50.003066 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-fc60ee99-1908-42ff-8ddc-3156e75035ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:50.009074 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fc60ee99-1908-42ff-8ddc-3156e75035ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:50.009553 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fc60ee99-1908-42ff-8ddc-3156e75035ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:50.009975 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fc60ee99-1908-42ff-8ddc-3156e75035ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:50.010656 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fc60ee99-1908-42ff-8ddc-3156e75035ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:50.011100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fc60ee99-1908-42ff-8ddc-3156e75035ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:50.011509 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fc60ee99-1908-42ff-8ddc-3156e75035ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:50.158170 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fc60ee99-1908-42ff-8ddc-3156e75035ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:50.166157 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fc60ee99-1908-42ff-8ddc-3156e75035ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:50.167594 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fc60ee99-1908-42ff-8ddc-3156e75035ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:50.168779 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-fc60ee99-1908-42ff-8ddc-3156e75035ea tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1747 microversion: 2.20 time: 0.172849 Aug 31 00:40:50.169332 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 386/782] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:49 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1747 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:50.284629 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-5ae01f8f-8851-4250-9f81-3f0722a51c58 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:50.285244 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-5ae01f8f-8851-4250-9f81-3f0722a51c58 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:50.291782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5ae01f8f-8851-4250-9f81-3f0722a51c58 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:50.292245 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5ae01f8f-8851-4250-9f81-3f0722a51c58 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:50.292781 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5ae01f8f-8851-4250-9f81-3f0722a51c58 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:50.293489 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5ae01f8f-8851-4250-9f81-3f0722a51c58 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:50.293945 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5ae01f8f-8851-4250-9f81-3f0722a51c58 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:50.294370 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5ae01f8f-8851-4250-9f81-3f0722a51c58 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:50.409397 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-73b69255-0c4b-48a3-b8f8-6fb09f77ee69 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:50.409655 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-73b69255-0c4b-48a3-b8f8-6fb09f77ee69 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:50.418230 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-73b69255-0c4b-48a3-b8f8-6fb09f77ee69 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:50.418354 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-73b69255-0c4b-48a3-b8f8-6fb09f77ee69 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:50.418724 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-73b69255-0c4b-48a3-b8f8-6fb09f77ee69 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:50.419431 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-73b69255-0c4b-48a3-b8f8-6fb09f77ee69 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:50.419894 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-73b69255-0c4b-48a3-b8f8-6fb09f77ee69 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:50.420571 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-73b69255-0c4b-48a3-b8f8-6fb09f77ee69 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:50.443460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-5ae01f8f-8851-4250-9f81-3f0722a51c58 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:50.461952 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-5ae01f8f-8851-4250-9f81-3f0722a51c58 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1363 microversion: 2.1 time: 0.180715 Aug 31 00:40:50.467213 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 397/783] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:50 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:50.516177 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-7dea02f0-f770-4d20-965d-57cfd25215bf req-7806442b-5dfb-4a74-b275-866635cb7ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "302d7397-56df-414b-a380-afc6b65fc8fa", "name": "network-vif-plugged", "status": "completed", "tag": "cfcd650e-10f6-464f-a79f-ed420080aea1"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:50.526589 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-7dea02f0-f770-4d20-965d-57cfd25215bf req-7806442b-5dfb-4a74-b275-866635cb7ab3 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:50.527308 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-7dea02f0-f770-4d20-965d-57cfd25215bf req-7806442b-5dfb-4a74-b275-866635cb7ab3 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:50.527743 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-7dea02f0-f770-4d20-965d-57cfd25215bf req-7806442b-5dfb-4a74-b275-866635cb7ab3 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:50.539278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-7dea02f0-f770-4d20-965d-57cfd25215bf req-7806442b-5dfb-4a74-b275-866635cb7ab3 service nova] Creating event network-vif-plugged:cfcd650e-10f6-464f-a79f-ed420080aea1 for instance 302d7397-56df-414b-a380-afc6b65fc8fa on hv-cinder-85221 Aug 31 00:40:50.544588 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-7dea02f0-f770-4d20-965d-57cfd25215bf req-7806442b-5dfb-4a74-b275-866635cb7ab3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032899 Aug 31 00:40:50.545227 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 398/784] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:50.565536 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-73b69255-0c4b-48a3-b8f8-6fb09f77ee69 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:50.573339 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-73b69255-0c4b-48a3-b8f8-6fb09f77ee69 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1367 microversion: 2.1 time: 0.169010 Aug 31 00:40:50.573901 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 387/785] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:50 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:51.194027 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ea9cc66c-bcf4-4424-b766-38450fe5478c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:51.194855 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ea9cc66c-bcf4-4424-b766-38450fe5478c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:51.201417 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ea9cc66c-bcf4-4424-b766-38450fe5478c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:51.201968 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ea9cc66c-bcf4-4424-b766-38450fe5478c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:51.202485 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ea9cc66c-bcf4-4424-b766-38450fe5478c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:51.203234 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ea9cc66c-bcf4-4424-b766-38450fe5478c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:51.203923 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ea9cc66c-bcf4-4424-b766-38450fe5478c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:51.204438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ea9cc66c-bcf4-4424-b766-38450fe5478c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:51.358251 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ea9cc66c-bcf4-4424-b766-38450fe5478c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:51.368471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ea9cc66c-bcf4-4424-b766-38450fe5478c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:51.370249 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ea9cc66c-bcf4-4424-b766-38450fe5478c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:51.371415 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ea9cc66c-bcf4-4424-b766-38450fe5478c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1742 microversion: 2.20 time: 0.182610 Aug 31 00:40:51.371973 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 399/786] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:51 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1742 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:51.491613 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-58ed7ee9-eedd-41fd-8ffd-b63dd31f20c6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:51.492454 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-58ed7ee9-eedd-41fd-8ffd-b63dd31f20c6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:51.499967 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-58ed7ee9-eedd-41fd-8ffd-b63dd31f20c6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:51.504669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-58ed7ee9-eedd-41fd-8ffd-b63dd31f20c6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:51.504669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-58ed7ee9-eedd-41fd-8ffd-b63dd31f20c6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:51.504669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-58ed7ee9-eedd-41fd-8ffd-b63dd31f20c6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:51.504669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-58ed7ee9-eedd-41fd-8ffd-b63dd31f20c6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:51.505625 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-58ed7ee9-eedd-41fd-8ffd-b63dd31f20c6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:51.596173 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-68f93e66-c0cf-40b5-88ae-f731c3f29f47 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:51.596947 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-68f93e66-c0cf-40b5-88ae-f731c3f29f47 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:51.603668 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-68f93e66-c0cf-40b5-88ae-f731c3f29f47 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:51.604577 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-68f93e66-c0cf-40b5-88ae-f731c3f29f47 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:51.605231 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-68f93e66-c0cf-40b5-88ae-f731c3f29f47 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:51.606224 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-68f93e66-c0cf-40b5-88ae-f731c3f29f47 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:51.606876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-68f93e66-c0cf-40b5-88ae-f731c3f29f47 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:51.608441 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-68f93e66-c0cf-40b5-88ae-f731c3f29f47 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:51.700927 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-58ed7ee9-eedd-41fd-8ffd-b63dd31f20c6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:51.710177 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-58ed7ee9-eedd-41fd-8ffd-b63dd31f20c6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1363 microversion: 2.1 time: 0.230840 Aug 31 00:40:51.710747 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 388/787] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:51 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:51.818362 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-68f93e66-c0cf-40b5-88ae-f731c3f29f47 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:51.844099 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-68f93e66-c0cf-40b5-88ae-f731c3f29f47 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1367 microversion: 2.1 time: 0.252622 Aug 31 00:40:51.859457 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 400/788] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:51 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:52.397485 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-b54b9818-fc81-493c-9a96-ff2d458becb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:52.398462 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-b54b9818-fc81-493c-9a96-ff2d458becb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:52.406864 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b54b9818-fc81-493c-9a96-ff2d458becb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:52.407496 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b54b9818-fc81-493c-9a96-ff2d458becb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:52.408238 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b54b9818-fc81-493c-9a96-ff2d458becb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:52.409060 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b54b9818-fc81-493c-9a96-ff2d458becb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:52.409847 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b54b9818-fc81-493c-9a96-ff2d458becb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:52.410592 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b54b9818-fc81-493c-9a96-ff2d458becb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:52.580509 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b54b9818-fc81-493c-9a96-ff2d458becb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:52.592369 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b54b9818-fc81-493c-9a96-ff2d458becb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:52.594800 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b54b9818-fc81-493c-9a96-ff2d458becb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:52.596104 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-b54b9818-fc81-493c-9a96-ff2d458becb0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1742 microversion: 2.20 time: 0.203001 Aug 31 00:40:52.597098 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 389/789] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:52 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1742 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:52.739514 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a4d63cc0-9664-41ba-b18b-4b5df0a5e691 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:52.740117 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a4d63cc0-9664-41ba-b18b-4b5df0a5e691 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:52.746834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a4d63cc0-9664-41ba-b18b-4b5df0a5e691 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:52.750563 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a4d63cc0-9664-41ba-b18b-4b5df0a5e691 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:52.750563 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a4d63cc0-9664-41ba-b18b-4b5df0a5e691 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:52.750563 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a4d63cc0-9664-41ba-b18b-4b5df0a5e691 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:52.750563 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a4d63cc0-9664-41ba-b18b-4b5df0a5e691 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:52.750893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a4d63cc0-9664-41ba-b18b-4b5df0a5e691 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:52.869391 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9ce71973-77d8-4799-926c-626d8a6dde43 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:52.870491 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9ce71973-77d8-4799-926c-626d8a6dde43 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:52.891577 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9ce71973-77d8-4799-926c-626d8a6dde43 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:52.895857 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9ce71973-77d8-4799-926c-626d8a6dde43 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:52.900922 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9ce71973-77d8-4799-926c-626d8a6dde43 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:52.902103 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9ce71973-77d8-4799-926c-626d8a6dde43 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:52.905642 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9ce71973-77d8-4799-926c-626d8a6dde43 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:52.906128 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9ce71973-77d8-4799-926c-626d8a6dde43 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:52.982062 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a4d63cc0-9664-41ba-b18b-4b5df0a5e691 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:52.992093 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a4d63cc0-9664-41ba-b18b-4b5df0a5e691 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1363 microversion: 2.1 time: 0.258106 Aug 31 00:40:53.007498 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 401/790] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:52 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:53.014229 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-e32a5058-cd37-4b43-a4b9-b0f014bf8f72 req-06b324ed-1ede-476a-8266-3897c290d002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50bd32a4-8af1-4f25-b417-e99467180ff3", "name": "network-vif-plugged", "status": "completed", "tag": "68a3ba26-0475-4d94-9656-0d4d923ff6d1"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:53.025148 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-e32a5058-cd37-4b43-a4b9-b0f014bf8f72 req-06b324ed-1ede-476a-8266-3897c290d002 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:53.025889 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-e32a5058-cd37-4b43-a4b9-b0f014bf8f72 req-06b324ed-1ede-476a-8266-3897c290d002 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:53.026483 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-e32a5058-cd37-4b43-a4b9-b0f014bf8f72 req-06b324ed-1ede-476a-8266-3897c290d002 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:53.039744 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-e32a5058-cd37-4b43-a4b9-b0f014bf8f72 req-06b324ed-1ede-476a-8266-3897c290d002 service nova] Creating event network-vif-plugged:68a3ba26-0475-4d94-9656-0d4d923ff6d1 for instance 50bd32a4-8af1-4f25-b417-e99467180ff3 on hv-cinder-85221 Aug 31 00:40:53.045468 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-e32a5058-cd37-4b43-a4b9-b0f014bf8f72 req-06b324ed-1ede-476a-8266-3897c290d002 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036015 Aug 31 00:40:53.047068 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 402/791] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:53.144864 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-9ce71973-77d8-4799-926c-626d8a6dde43 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:53.157584 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9ce71973-77d8-4799-926c-626d8a6dde43 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1367 microversion: 2.1 time: 0.292191 Aug 31 00:40:53.158887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 390/792] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:52 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:53.624917 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d5087269-39c6-44dd-8e51-cfcf8d4e3b5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:53.627599 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d5087269-39c6-44dd-8e51-cfcf8d4e3b5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:53.641751 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d5087269-39c6-44dd-8e51-cfcf8d4e3b5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:53.644701 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d5087269-39c6-44dd-8e51-cfcf8d4e3b5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:53.645556 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d5087269-39c6-44dd-8e51-cfcf8d4e3b5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:53.646834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d5087269-39c6-44dd-8e51-cfcf8d4e3b5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:53.649163 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d5087269-39c6-44dd-8e51-cfcf8d4e3b5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:53.650117 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d5087269-39c6-44dd-8e51-cfcf8d4e3b5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:53.693327 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=100 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:53.858356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d5087269-39c6-44dd-8e51-cfcf8d4e3b5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:53.868295 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d5087269-39c6-44dd-8e51-cfcf8d4e3b5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:53.872118 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d5087269-39c6-44dd-8e51-cfcf8d4e3b5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:53.873604 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d5087269-39c6-44dd-8e51-cfcf8d4e3b5f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1742 microversion: 2.20 time: 0.253872 Aug 31 00:40:53.876205 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 403/793] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:53 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1742 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:54.016811 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f53aad03-f68d-4419-8a6a-fb4f375cb2e1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:54.018091 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-f53aad03-f68d-4419-8a6a-fb4f375cb2e1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:54.029282 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f53aad03-f68d-4419-8a6a-fb4f375cb2e1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:54.033398 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f53aad03-f68d-4419-8a6a-fb4f375cb2e1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:54.034929 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f53aad03-f68d-4419-8a6a-fb4f375cb2e1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:54.035707 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f53aad03-f68d-4419-8a6a-fb4f375cb2e1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:54.036138 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f53aad03-f68d-4419-8a6a-fb4f375cb2e1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:54.036679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f53aad03-f68d-4419-8a6a-fb4f375cb2e1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:54.181854 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-af96317f-2cae-4dc8-bef0-7b1d34c2b820 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:54.182482 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-af96317f-2cae-4dc8-bef0-7b1d34c2b820 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:54.190663 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-af96317f-2cae-4dc8-bef0-7b1d34c2b820 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:54.191491 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-af96317f-2cae-4dc8-bef0-7b1d34c2b820 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:54.191995 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-af96317f-2cae-4dc8-bef0-7b1d34c2b820 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:54.192848 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-af96317f-2cae-4dc8-bef0-7b1d34c2b820 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:54.193306 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-af96317f-2cae-4dc8-bef0-7b1d34c2b820 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:54.193971 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-af96317f-2cae-4dc8-bef0-7b1d34c2b820 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:54.235765 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f53aad03-f68d-4419-8a6a-fb4f375cb2e1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:54.247146 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f53aad03-f68d-4419-8a6a-fb4f375cb2e1 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1363 microversion: 2.1 time: 0.236138 Aug 31 00:40:54.262691 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 391/794] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:54 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:54.348148 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-af96317f-2cae-4dc8-bef0-7b1d34c2b820 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:54.356753 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-af96317f-2cae-4dc8-bef0-7b1d34c2b820 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1367 microversion: 2.1 time: 0.179021 Aug 31 00:40:54.357379 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 404/795] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:54 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:54.908424 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f709495f-fe95-4544-9a98-8b132c5aa97b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:54.908997 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-f709495f-fe95-4544-9a98-8b132c5aa97b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:54.915997 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f709495f-fe95-4544-9a98-8b132c5aa97b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:54.916515 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f709495f-fe95-4544-9a98-8b132c5aa97b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:54.919493 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f709495f-fe95-4544-9a98-8b132c5aa97b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:54.919493 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f709495f-fe95-4544-9a98-8b132c5aa97b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:54.919493 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f709495f-fe95-4544-9a98-8b132c5aa97b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:54.919493 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f709495f-fe95-4544-9a98-8b132c5aa97b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:55.067047 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-3bbbe18d-f7f9-4b9b-b1ab-316617a78245 req-89bee75f-1653-4b81-b92f-b10e8a5d7253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf8cd0c7-4af8-443b-9f8d-d878cc6137e7", "name": "network-vif-plugged", "status": "completed", "tag": "a5078607-db3e-4a97-b7ea-6ced696b1877"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:55.083749 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f709495f-fe95-4544-9a98-8b132c5aa97b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:55.087805 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-3bbbe18d-f7f9-4b9b-b1ab-316617a78245 req-89bee75f-1653-4b81-b92f-b10e8a5d7253 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:55.090929 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-3bbbe18d-f7f9-4b9b-b1ab-316617a78245 req-89bee75f-1653-4b81-b92f-b10e8a5d7253 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:55.093692 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-3bbbe18d-f7f9-4b9b-b1ab-316617a78245 req-89bee75f-1653-4b81-b92f-b10e8a5d7253 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:55.095680 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f709495f-fe95-4544-9a98-8b132c5aa97b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:55.097738 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f709495f-fe95-4544-9a98-8b132c5aa97b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:55.099398 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f709495f-fe95-4544-9a98-8b132c5aa97b tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1742 microversion: 2.20 time: 0.196691 Aug 31 00:40:55.100512 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 392/796] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:54 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1742 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:55.153673 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-3bbbe18d-f7f9-4b9b-b1ab-316617a78245 req-89bee75f-1653-4b81-b92f-b10e8a5d7253 service nova] Creating event network-vif-plugged:a5078607-db3e-4a97-b7ea-6ced696b1877 for instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 on hv-cinder-85221 Aug 31 00:40:55.153673 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-3bbbe18d-f7f9-4b9b-b1ab-316617a78245 req-89bee75f-1653-4b81-b92f-b10e8a5d7253 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083812 Aug 31 00:40:55.153673 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 405/797] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:55.269176 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-74370e4a-54e8-4dc7-995a-730aecb329e6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:55.269867 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-74370e4a-54e8-4dc7-995a-730aecb329e6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:55.276690 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-74370e4a-54e8-4dc7-995a-730aecb329e6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:55.277688 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-74370e4a-54e8-4dc7-995a-730aecb329e6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:55.278339 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-74370e4a-54e8-4dc7-995a-730aecb329e6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:55.279275 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-74370e4a-54e8-4dc7-995a-730aecb329e6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:55.280373 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-74370e4a-54e8-4dc7-995a-730aecb329e6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:55.281194 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-74370e4a-54e8-4dc7-995a-730aecb329e6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:55.384023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a9cae921-d164-4123-8594-1761adbaa976 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:55.385166 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a9cae921-d164-4123-8594-1761adbaa976 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:55.392931 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a9cae921-d164-4123-8594-1761adbaa976 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:55.393755 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a9cae921-d164-4123-8594-1761adbaa976 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:55.394408 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a9cae921-d164-4123-8594-1761adbaa976 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:55.395323 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a9cae921-d164-4123-8594-1761adbaa976 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:55.396262 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a9cae921-d164-4123-8594-1761adbaa976 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:55.396901 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a9cae921-d164-4123-8594-1761adbaa976 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:55.446066 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-74370e4a-54e8-4dc7-995a-730aecb329e6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:55.458760 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-74370e4a-54e8-4dc7-995a-730aecb329e6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1363 microversion: 2.1 time: 0.193479 Aug 31 00:40:55.472718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 393/798] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:55 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:55.571282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a9cae921-d164-4123-8594-1761adbaa976 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:55.586134 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a9cae921-d164-4123-8594-1761adbaa976 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1367 microversion: 2.1 time: 0.204466 Aug 31 00:40:55.586728 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 406/799] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:55 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:56.126582 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-22822c55-a36a-478d-9ce2-c26075c59f5c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:56.127917 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-22822c55-a36a-478d-9ce2-c26075c59f5c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:56.134594 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-22822c55-a36a-478d-9ce2-c26075c59f5c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:56.135326 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-22822c55-a36a-478d-9ce2-c26075c59f5c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:56.136095 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-22822c55-a36a-478d-9ce2-c26075c59f5c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:56.137803 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-22822c55-a36a-478d-9ce2-c26075c59f5c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:56.138957 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-22822c55-a36a-478d-9ce2-c26075c59f5c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:56.139834 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-22822c55-a36a-478d-9ce2-c26075c59f5c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:56.316872 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-22822c55-a36a-478d-9ce2-c26075c59f5c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:56.332039 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-22822c55-a36a-478d-9ce2-c26075c59f5c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:56.334046 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-22822c55-a36a-478d-9ce2-c26075c59f5c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:56.335264 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-22822c55-a36a-478d-9ce2-c26075c59f5c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1742 microversion: 2.20 time: 0.213305 Aug 31 00:40:56.335976 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 394/800] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:56 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1742 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:56.479081 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-867597e5-3c66-4b97-9053-7773fef66f6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:56.480283 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-867597e5-3c66-4b97-9053-7773fef66f6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:56.493927 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-867597e5-3c66-4b97-9053-7773fef66f6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:56.494637 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-867597e5-3c66-4b97-9053-7773fef66f6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:56.495245 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-867597e5-3c66-4b97-9053-7773fef66f6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:56.496202 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-867597e5-3c66-4b97-9053-7773fef66f6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:56.496839 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-867597e5-3c66-4b97-9053-7773fef66f6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:56.497403 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-867597e5-3c66-4b97-9053-7773fef66f6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:56.606897 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7a28e4b7-3cdb-4bd8-9f6a-0d12991c3ded tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:56.607838 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7a28e4b7-3cdb-4bd8-9f6a-0d12991c3ded tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:56.618859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a28e4b7-3cdb-4bd8-9f6a-0d12991c3ded tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:56.620863 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a28e4b7-3cdb-4bd8-9f6a-0d12991c3ded tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:56.621531 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a28e4b7-3cdb-4bd8-9f6a-0d12991c3ded tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:56.622483 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a28e4b7-3cdb-4bd8-9f6a-0d12991c3ded tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:56.626368 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a28e4b7-3cdb-4bd8-9f6a-0d12991c3ded tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:56.627071 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7a28e4b7-3cdb-4bd8-9f6a-0d12991c3ded tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:56.698729 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-867597e5-3c66-4b97-9053-7773fef66f6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:56.711351 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-867597e5-3c66-4b97-9053-7773fef66f6b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1363 microversion: 2.1 time: 0.235225 Aug 31 00:40:56.717647 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 407/801] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:56 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:56.802663 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-7a28e4b7-3cdb-4bd8-9f6a-0d12991c3ded tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:56.817483 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-7a28e4b7-3cdb-4bd8-9f6a-0d12991c3ded tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1557 microversion: 2.1 time: 0.214194 Aug 31 00:40:56.821037 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 395/802] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:56 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:56.847123 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8df9af4d-2e26-4a37-a0db-0c035c906f28 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:56.848569 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8df9af4d-2e26-4a37-a0db-0c035c906f28 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:56.866334 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8df9af4d-2e26-4a37-a0db-0c035c906f28 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:56.866843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8df9af4d-2e26-4a37-a0db-0c035c906f28 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:56.867298 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8df9af4d-2e26-4a37-a0db-0c035c906f28 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:56.868371 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8df9af4d-2e26-4a37-a0db-0c035c906f28 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:56.873939 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8df9af4d-2e26-4a37-a0db-0c035c906f28 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:56.876942 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8df9af4d-2e26-4a37-a0db-0c035c906f28 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:56.986584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8df9af4d-2e26-4a37-a0db-0c035c906f28 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.147804 Aug 31 00:40:56.995054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 408/803] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 31 00:40:56 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-interface => generated 285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:40:57.360270 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-fcbfefb5-1023-4f4c-bd07-022c9f1ea038 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:57.361596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-fcbfefb5-1023-4f4c-bd07-022c9f1ea038 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:57.372058 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fcbfefb5-1023-4f4c-bd07-022c9f1ea038 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:57.374045 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fcbfefb5-1023-4f4c-bd07-022c9f1ea038 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:57.374487 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fcbfefb5-1023-4f4c-bd07-022c9f1ea038 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:57.375690 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fcbfefb5-1023-4f4c-bd07-022c9f1ea038 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:57.376144 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fcbfefb5-1023-4f4c-bd07-022c9f1ea038 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:57.376588 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fcbfefb5-1023-4f4c-bd07-022c9f1ea038 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:57.728477 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fcbfefb5-1023-4f4c-bd07-022c9f1ea038 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:57.734270 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-165258e5-4d4e-4afb-a5bf-2b00c16e0bfd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:57.735481 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-165258e5-4d4e-4afb-a5bf-2b00c16e0bfd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:57.737283 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fcbfefb5-1023-4f4c-bd07-022c9f1ea038 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:57.738761 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fcbfefb5-1023-4f4c-bd07-022c9f1ea038 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:57.740156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-fcbfefb5-1023-4f4c-bd07-022c9f1ea038 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1742 microversion: 2.20 time: 0.384799 Aug 31 00:40:57.752370 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 396/804] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:57 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1742 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:57.752564 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-165258e5-4d4e-4afb-a5bf-2b00c16e0bfd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:57.752564 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-165258e5-4d4e-4afb-a5bf-2b00c16e0bfd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:57.752564 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-165258e5-4d4e-4afb-a5bf-2b00c16e0bfd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:57.752564 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-165258e5-4d4e-4afb-a5bf-2b00c16e0bfd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:57.752886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-165258e5-4d4e-4afb-a5bf-2b00c16e0bfd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:57.752886 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-165258e5-4d4e-4afb-a5bf-2b00c16e0bfd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:57.921683 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-165258e5-4d4e-4afb-a5bf-2b00c16e0bfd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:57.930401 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-165258e5-4d4e-4afb-a5bf-2b00c16e0bfd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1363 microversion: 2.1 time: 0.199899 Aug 31 00:40:57.931113 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 409/805] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:57 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:40:58.767409 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f2944bdc-8118-49fc-a23b-e59c3a4a0869 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:58.769734 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-f2944bdc-8118-49fc-a23b-e59c3a4a0869 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:58.794819 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f2944bdc-8118-49fc-a23b-e59c3a4a0869 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:58.796049 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f2944bdc-8118-49fc-a23b-e59c3a4a0869 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:58.796533 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f2944bdc-8118-49fc-a23b-e59c3a4a0869 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:58.797281 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f2944bdc-8118-49fc-a23b-e59c3a4a0869 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:58.797708 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f2944bdc-8118-49fc-a23b-e59c3a4a0869 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:58.798130 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f2944bdc-8118-49fc-a23b-e59c3a4a0869 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:58.955924 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b68756fe-76d6-4bc6-997a-6b166cad0b23 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:58.956552 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-b68756fe-76d6-4bc6-997a-6b166cad0b23 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:58.970388 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b68756fe-76d6-4bc6-997a-6b166cad0b23 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:58.971760 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b68756fe-76d6-4bc6-997a-6b166cad0b23 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:58.971964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b68756fe-76d6-4bc6-997a-6b166cad0b23 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:58.972711 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b68756fe-76d6-4bc6-997a-6b166cad0b23 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:58.973355 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b68756fe-76d6-4bc6-997a-6b166cad0b23 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:58.976827 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b68756fe-76d6-4bc6-997a-6b166cad0b23 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:59.205434 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f2944bdc-8118-49fc-a23b-e59c3a4a0869 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:59.214551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-b68756fe-76d6-4bc6-997a-6b166cad0b23 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:59.214797 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f2944bdc-8118-49fc-a23b-e59c3a4a0869 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:59.216359 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f2944bdc-8118-49fc-a23b-e59c3a4a0869 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:40:59.225567 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-b68756fe-76d6-4bc6-997a-6b166cad0b23 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1548 microversion: 2.1 time: 0.274819 Aug 31 00:40:59.227344 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f2944bdc-8118-49fc-a23b-e59c3a4a0869 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1742 microversion: 2.20 time: 0.465938 Aug 31 00:40:59.229215 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 410/806] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:40:58 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1548 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:40:59.253857 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 397/807] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:40:58 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1742 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:40:59.257030 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-696065c2-8d52-4609-a4c0-978c20ca878d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:40:59.257771 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-696065c2-8d52-4609-a4c0-978c20ca878d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:40:59.272904 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-696065c2-8d52-4609-a4c0-978c20ca878d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:59.273911 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-696065c2-8d52-4609-a4c0-978c20ca878d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:59.274850 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-696065c2-8d52-4609-a4c0-978c20ca878d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:59.278246 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-696065c2-8d52-4609-a4c0-978c20ca878d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:59.278968 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-696065c2-8d52-4609-a4c0-978c20ca878d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:59.280812 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-696065c2-8d52-4609-a4c0-978c20ca878d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:59.469356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-696065c2-8d52-4609-a4c0-978c20ca878d tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.216358 Aug 31 00:40:59.470672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 411/808] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 31 00:40:59 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-interface => generated 284 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:40:59.514390 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-bfa94db5-bfc9-4c29-8d20-428af9518cc9 req-6c16370a-17be-4ddf-94ad-5eee94c96a2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50bd32a4-8af1-4f25-b417-e99467180ff3", "tag": "68a3ba26-0475-4d94-9656-0d4d923ff6d1"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:40:59.530676 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-bfa94db5-bfc9-4c29-8d20-428af9518cc9 req-6c16370a-17be-4ddf-94ad-5eee94c96a2c service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:40:59.531916 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-bfa94db5-bfc9-4c29-8d20-428af9518cc9 req-6c16370a-17be-4ddf-94ad-5eee94c96a2c service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:40:59.532620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-bfa94db5-bfc9-4c29-8d20-428af9518cc9 req-6c16370a-17be-4ddf-94ad-5eee94c96a2c service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:40:59.556553 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-bfa94db5-bfc9-4c29-8d20-428af9518cc9 req-6c16370a-17be-4ddf-94ad-5eee94c96a2c service nova] Creating event network-changed:68a3ba26-0475-4d94-9656-0d4d923ff6d1 for instance 50bd32a4-8af1-4f25-b417-e99467180ff3 on hv-cinder-85221 Aug 31 00:40:59.566012 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-bfa94db5-bfc9-4c29-8d20-428af9518cc9 req-6c16370a-17be-4ddf-94ad-5eee94c96a2c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056834 Aug 31 00:40:59.566606 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 398/809] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:41:00.282010 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-44f8422c-2f4b-452f-84e0-16032d243517 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:00.283437 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-44f8422c-2f4b-452f-84e0-16032d243517 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:00.294848 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-44f8422c-2f4b-452f-84e0-16032d243517 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:00.299507 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-44f8422c-2f4b-452f-84e0-16032d243517 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:00.300110 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-44f8422c-2f4b-452f-84e0-16032d243517 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:00.301414 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-44f8422c-2f4b-452f-84e0-16032d243517 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:00.302175 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-44f8422c-2f4b-452f-84e0-16032d243517 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:00.302614 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-44f8422c-2f4b-452f-84e0-16032d243517 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:00.650009 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-44f8422c-2f4b-452f-84e0-16032d243517 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:00.662899 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-44f8422c-2f4b-452f-84e0-16032d243517 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:00.664864 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-44f8422c-2f4b-452f-84e0-16032d243517 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:00.668202 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-44f8422c-2f4b-452f-84e0-16032d243517 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1742 microversion: 2.20 time: 0.389889 Aug 31 00:41:00.668202 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 412/810] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:00 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1742 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:01.694027 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6a8c4f73-303b-4867-929e-1a6efa847c61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:01.694751 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6a8c4f73-303b-4867-929e-1a6efa847c61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:01.704455 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6a8c4f73-303b-4867-929e-1a6efa847c61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:01.704952 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6a8c4f73-303b-4867-929e-1a6efa847c61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:01.715695 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6a8c4f73-303b-4867-929e-1a6efa847c61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:01.716486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6a8c4f73-303b-4867-929e-1a6efa847c61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:01.717681 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6a8c4f73-303b-4867-929e-1a6efa847c61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:01.718355 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6a8c4f73-303b-4867-929e-1a6efa847c61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:01.759143 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-75303c58-f506-4ae9-a511-29db76640e98 req-bd29f046-a4a2-40df-84fe-9954c1f13e70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf8cd0c7-4af8-443b-9f8d-d878cc6137e7", "tag": "a5078607-db3e-4a97-b7ea-6ced696b1877"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:41:01.770862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-75303c58-f506-4ae9-a511-29db76640e98 req-bd29f046-a4a2-40df-84fe-9954c1f13e70 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:01.771753 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-75303c58-f506-4ae9-a511-29db76640e98 req-bd29f046-a4a2-40df-84fe-9954c1f13e70 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:01.772426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-75303c58-f506-4ae9-a511-29db76640e98 req-bd29f046-a4a2-40df-84fe-9954c1f13e70 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:01.806169 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-75303c58-f506-4ae9-a511-29db76640e98 req-bd29f046-a4a2-40df-84fe-9954c1f13e70 service nova] Creating event network-changed:a5078607-db3e-4a97-b7ea-6ced696b1877 for instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 on hv-cinder-85221 Aug 31 00:41:01.811795 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-75303c58-f506-4ae9-a511-29db76640e98 req-bd29f046-a4a2-40df-84fe-9954c1f13e70 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.255506 Aug 31 00:41:01.812947 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 399/811] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:01.944369 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6a8c4f73-303b-4867-929e-1a6efa847c61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:01.960057 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6a8c4f73-303b-4867-929e-1a6efa847c61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:01.968067 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6a8c4f73-303b-4867-929e-1a6efa847c61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:01.968255 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6a8c4f73-303b-4867-929e-1a6efa847c61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1742 microversion: 2.20 time: 0.278652 Aug 31 00:41:01.969373 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 413/812] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:01 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1742 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:41:02.994847 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-2cb81117-a0af-4312-ab89-60c91e22f15f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:02.998779 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-2cb81117-a0af-4312-ab89-60c91e22f15f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:03.007366 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2cb81117-a0af-4312-ab89-60c91e22f15f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:03.008603 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2cb81117-a0af-4312-ab89-60c91e22f15f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:03.009191 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2cb81117-a0af-4312-ab89-60c91e22f15f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:03.010237 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2cb81117-a0af-4312-ab89-60c91e22f15f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:03.010884 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2cb81117-a0af-4312-ab89-60c91e22f15f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:03.011497 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2cb81117-a0af-4312-ab89-60c91e22f15f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:03.213344 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-2cb81117-a0af-4312-ab89-60c91e22f15f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:03.224192 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-2cb81117-a0af-4312-ab89-60c91e22f15f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:03.227612 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-2cb81117-a0af-4312-ab89-60c91e22f15f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:03.229265 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-2cb81117-a0af-4312-ab89-60c91e22f15f tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1742 microversion: 2.20 time: 0.239591 Aug 31 00:41:03.245068 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 400/813] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:02 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1742 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:04.258440 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-de3a2d18-e8b8-4bdb-b643-0484fe52d128 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:04.259172 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-de3a2d18-e8b8-4bdb-b643-0484fe52d128 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:04.265929 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-de3a2d18-e8b8-4bdb-b643-0484fe52d128 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:04.269030 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-de3a2d18-e8b8-4bdb-b643-0484fe52d128 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:04.269030 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-de3a2d18-e8b8-4bdb-b643-0484fe52d128 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:04.269030 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-de3a2d18-e8b8-4bdb-b643-0484fe52d128 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:04.269030 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-de3a2d18-e8b8-4bdb-b643-0484fe52d128 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:04.269409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-de3a2d18-e8b8-4bdb-b643-0484fe52d128 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:04.411308 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-de3a2d18-e8b8-4bdb-b643-0484fe52d128 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:04.420165 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-de3a2d18-e8b8-4bdb-b643-0484fe52d128 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:04.421801 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-de3a2d18-e8b8-4bdb-b643-0484fe52d128 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:04.422980 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-de3a2d18-e8b8-4bdb-b643-0484fe52d128 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1742 microversion: 2.20 time: 0.169719 Aug 31 00:41:04.423729 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 414/814] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:04 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:05.450161 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c069afde-694b-41b1-a94c-ee434b9f97cb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:05.450778 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c069afde-694b-41b1-a94c-ee434b9f97cb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:05.457726 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c069afde-694b-41b1-a94c-ee434b9f97cb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:05.458265 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c069afde-694b-41b1-a94c-ee434b9f97cb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:05.458709 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c069afde-694b-41b1-a94c-ee434b9f97cb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:05.459910 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c069afde-694b-41b1-a94c-ee434b9f97cb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:05.459910 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c069afde-694b-41b1-a94c-ee434b9f97cb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:05.460248 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c069afde-694b-41b1-a94c-ee434b9f97cb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:05.597417 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c069afde-694b-41b1-a94c-ee434b9f97cb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:05.599673 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=100 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:05.606849 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c069afde-694b-41b1-a94c-ee434b9f97cb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:05.608469 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c069afde-694b-41b1-a94c-ee434b9f97cb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:05.609627 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-c069afde-694b-41b1-a94c-ee434b9f97cb tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1724 microversion: 2.20 time: 0.163494 Aug 31 00:41:05.610175 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 401/815] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:05 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:06.633899 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-9edb64f8-ddb8-4023-a025-6ad86dd26359 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:06.634444 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-9edb64f8-ddb8-4023-a025-6ad86dd26359 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:06.641165 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9edb64f8-ddb8-4023-a025-6ad86dd26359 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:06.641646 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9edb64f8-ddb8-4023-a025-6ad86dd26359 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:06.642140 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9edb64f8-ddb8-4023-a025-6ad86dd26359 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:06.642823 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9edb64f8-ddb8-4023-a025-6ad86dd26359 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:06.643270 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9edb64f8-ddb8-4023-a025-6ad86dd26359 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:06.643719 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9edb64f8-ddb8-4023-a025-6ad86dd26359 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:06.775265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-9edb64f8-ddb8-4023-a025-6ad86dd26359 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:06.784275 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-9edb64f8-ddb8-4023-a025-6ad86dd26359 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:06.785773 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-9edb64f8-ddb8-4023-a025-6ad86dd26359 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:06.786923 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-9edb64f8-ddb8-4023-a025-6ad86dd26359 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1724 microversion: 2.20 time: 0.157094 Aug 31 00:41:06.787478 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 415/816] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:06 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:07.810506 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-71a6b47b-ee75-4e65-92d1-a78a7ee94c66 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:07.811088 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-71a6b47b-ee75-4e65-92d1-a78a7ee94c66 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:07.819265 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-71a6b47b-ee75-4e65-92d1-a78a7ee94c66 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:07.819787 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-71a6b47b-ee75-4e65-92d1-a78a7ee94c66 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:07.820242 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-71a6b47b-ee75-4e65-92d1-a78a7ee94c66 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:07.820954 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-71a6b47b-ee75-4e65-92d1-a78a7ee94c66 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:07.821419 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-71a6b47b-ee75-4e65-92d1-a78a7ee94c66 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:07.821843 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-71a6b47b-ee75-4e65-92d1-a78a7ee94c66 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:07.964678 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-71a6b47b-ee75-4e65-92d1-a78a7ee94c66 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:07.974077 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-71a6b47b-ee75-4e65-92d1-a78a7ee94c66 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:07.975288 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-71a6b47b-ee75-4e65-92d1-a78a7ee94c66 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:07.976461 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-71a6b47b-ee75-4e65-92d1-a78a7ee94c66 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1727 microversion: 2.20 time: 0.169817 Aug 31 00:41:07.977011 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 402/817] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:07 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:08.000602 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-bf4b4a5d-0049-47ca-b45f-d64a0a759635 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5266dfa-c831-4850-8f7e-3de25aeaf5ed"}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:41:08.003025 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-bf4b4a5d-0049-47ca-b45f-d64a0a759635 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:08.005578 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=85 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:08.010383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf4b4a5d-0049-47ca-b45f-d64a0a759635 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:08.010927 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf4b4a5d-0049-47ca-b45f-d64a0a759635 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:08.012770 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf4b4a5d-0049-47ca-b45f-d64a0a759635 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:08.013489 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf4b4a5d-0049-47ca-b45f-d64a0a759635 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:08.014127 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf4b4a5d-0049-47ca-b45f-d64a0a759635 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:08.014796 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf4b4a5d-0049-47ca-b45f-d64a0a759635 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:08.841538 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-f32049da-180d-479f-bc27-bcf04ff57911 req-64fc811f-18ee-4ac6-8e77-804901682e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "302d7397-56df-414b-a380-afc6b65fc8fa", "name": "network-vif-unplugged", "status": "completed", "tag": "cfcd650e-10f6-464f-a79f-ed420080aea1"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:41:08.857398 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-f32049da-180d-479f-bc27-bcf04ff57911 req-64fc811f-18ee-4ac6-8e77-804901682e09 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:08.857905 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-f32049da-180d-479f-bc27-bcf04ff57911 req-64fc811f-18ee-4ac6-8e77-804901682e09 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:08.858861 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-f32049da-180d-479f-bc27-bcf04ff57911 req-64fc811f-18ee-4ac6-8e77-804901682e09 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:08.871232 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.compute.server_external_events [req-f32049da-180d-479f-bc27-bcf04ff57911 req-64fc811f-18ee-4ac6-8e77-804901682e09 service nova] Unable to find a host for instance 302d7397-56df-414b-a380-afc6b65fc8fa. Dropping event network-vif-unplugged {{(pid=128048) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 00:41:08.872120 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-f32049da-180d-479f-bc27-bcf04ff57911 req-64fc811f-18ee-4ac6-8e77-804901682e09 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034449 Aug 31 00:41:08.872753 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 403/818] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 31 00:41:09.089573 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-bf4b4a5d-0049-47ca-b45f-d64a0a759635 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "POST /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.093958 Aug 31 00:41:09.090193 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 416/819] 10.222.0.65 () {62 vars in 1364 bytes} [Wed Aug 31 00:41:07 2022] POST /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa/os-volume_attachments => generated 188 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 00:41:09.225074 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d77cc357-04c8-4297-84f5-0a01c911efc2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:09.230066 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d77cc357-04c8-4297-84f5-0a01c911efc2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:09.231364 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d77cc357-04c8-4297-84f5-0a01c911efc2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:09.231837 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d77cc357-04c8-4297-84f5-0a01c911efc2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:09.232262 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d77cc357-04c8-4297-84f5-0a01c911efc2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:09.232968 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d77cc357-04c8-4297-84f5-0a01c911efc2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:09.234065 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d77cc357-04c8-4297-84f5-0a01c911efc2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:09.234541 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d77cc357-04c8-4297-84f5-0a01c911efc2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:09.853764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d77cc357-04c8-4297-84f5-0a01c911efc2 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "DELETE /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa/os-volume_attachments/e5266dfa-c831-4850-8f7e-3de25aeaf5ed" status: 202 len: 0 microversion: 2.20 time: 0.628306 Aug 31 00:41:09.853764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 404/820] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Aug 31 00:41:09 2022] DELETE /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa/os-volume_attachments/e5266dfa-c831-4850-8f7e-3de25aeaf5ed => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:41:09.911135 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-dfcb2c91-f76f-4313-af79-033e1b078967 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:41:09.911719 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-dfcb2c91-f76f-4313-af79-033e1b078967 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:09.917638 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dfcb2c91-f76f-4313-af79-033e1b078967 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:09.918107 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dfcb2c91-f76f-4313-af79-033e1b078967 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:09.918532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dfcb2c91-f76f-4313-af79-033e1b078967 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:09.919610 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dfcb2c91-f76f-4313-af79-033e1b078967 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:09.919610 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dfcb2c91-f76f-4313-af79-033e1b078967 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:09.920205 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dfcb2c91-f76f-4313-af79-033e1b078967 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:09.964171 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-dfcb2c91-f76f-4313-af79-033e1b078967 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128049) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 00:41:10.128369 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:10.257802 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-dfcb2c91-f76f-4313-af79-033e1b078967 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "POST /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa/action" status: 202 len: 0 microversion: 2.20 time: 0.350432 Aug 31 00:41:10.260347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 417/821] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 31 00:41:09 2022] POST /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:41:10.268294 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-568f20d1-6bbc-4445-939a-2da497657733 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:10.275702 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-568f20d1-6bbc-4445-939a-2da497657733 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:10.279086 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-568f20d1-6bbc-4445-939a-2da497657733 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:10.279789 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-568f20d1-6bbc-4445-939a-2da497657733 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:10.280295 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-568f20d1-6bbc-4445-939a-2da497657733 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:10.281812 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-568f20d1-6bbc-4445-939a-2da497657733 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:10.282339 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-568f20d1-6bbc-4445-939a-2da497657733 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:10.282908 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-568f20d1-6bbc-4445-939a-2da497657733 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:10.428583 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-568f20d1-6bbc-4445-939a-2da497657733 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:10.442312 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-568f20d1-6bbc-4445-939a-2da497657733 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:10.443971 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-568f20d1-6bbc-4445-939a-2da497657733 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:10.445332 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-568f20d1-6bbc-4445-939a-2da497657733 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1675 microversion: 2.20 time: 0.182482 Aug 31 00:41:10.446051 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 405/822] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:10 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:11.470000 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-41aa9e70-9c72-4565-b28d-5ebe590e0b52 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:11.470721 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-41aa9e70-9c72-4565-b28d-5ebe590e0b52 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:11.477575 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-41aa9e70-9c72-4565-b28d-5ebe590e0b52 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:11.478055 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-41aa9e70-9c72-4565-b28d-5ebe590e0b52 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:11.478666 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-41aa9e70-9c72-4565-b28d-5ebe590e0b52 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:11.479533 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-41aa9e70-9c72-4565-b28d-5ebe590e0b52 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:11.480193 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-41aa9e70-9c72-4565-b28d-5ebe590e0b52 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:11.480644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-41aa9e70-9c72-4565-b28d-5ebe590e0b52 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:11.613997 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-41aa9e70-9c72-4565-b28d-5ebe590e0b52 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:11.628678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-41aa9e70-9c72-4565-b28d-5ebe590e0b52 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:11.628678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-41aa9e70-9c72-4565-b28d-5ebe590e0b52 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:11.628678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-41aa9e70-9c72-4565-b28d-5ebe590e0b52 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1675 microversion: 2.20 time: 0.160311 Aug 31 00:41:11.628977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 418/823] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:11 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:12.649932 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-87a9cd9f-2056-4f10-98fc-35387318e159 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:12.650619 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-87a9cd9f-2056-4f10-98fc-35387318e159 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:12.658220 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-87a9cd9f-2056-4f10-98fc-35387318e159 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:12.659265 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-87a9cd9f-2056-4f10-98fc-35387318e159 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:12.659954 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-87a9cd9f-2056-4f10-98fc-35387318e159 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:12.661275 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-87a9cd9f-2056-4f10-98fc-35387318e159 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:12.661927 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-87a9cd9f-2056-4f10-98fc-35387318e159 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:12.662347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-87a9cd9f-2056-4f10-98fc-35387318e159 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:12.797060 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-87a9cd9f-2056-4f10-98fc-35387318e159 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:12.805681 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-87a9cd9f-2056-4f10-98fc-35387318e159 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:12.807252 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-87a9cd9f-2056-4f10-98fc-35387318e159 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:12.808486 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-87a9cd9f-2056-4f10-98fc-35387318e159 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1733 microversion: 2.20 time: 0.163233 Aug 31 00:41:12.809035 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 406/824] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:12 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:13.832420 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a3852623-50bd-44e5-a823-0e84f0be69a9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:13.833020 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a3852623-50bd-44e5-a823-0e84f0be69a9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:13.839415 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a3852623-50bd-44e5-a823-0e84f0be69a9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:13.839893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a3852623-50bd-44e5-a823-0e84f0be69a9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:13.840341 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a3852623-50bd-44e5-a823-0e84f0be69a9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:13.841029 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a3852623-50bd-44e5-a823-0e84f0be69a9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:13.841473 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a3852623-50bd-44e5-a823-0e84f0be69a9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:13.841888 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a3852623-50bd-44e5-a823-0e84f0be69a9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:13.984208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a3852623-50bd-44e5-a823-0e84f0be69a9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:13.993376 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a3852623-50bd-44e5-a823-0e84f0be69a9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:13.994800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a3852623-50bd-44e5-a823-0e84f0be69a9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:13.995950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a3852623-50bd-44e5-a823-0e84f0be69a9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1733 microversion: 2.20 time: 0.167493 Aug 31 00:41:13.996887 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 419/825] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:13 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:15.020010 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-93efbb31-db16-48db-9628-2847585ec671 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:15.020739 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-93efbb31-db16-48db-9628-2847585ec671 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:15.027868 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-93efbb31-db16-48db-9628-2847585ec671 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:15.029674 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-93efbb31-db16-48db-9628-2847585ec671 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:15.030350 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-93efbb31-db16-48db-9628-2847585ec671 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:15.033323 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-93efbb31-db16-48db-9628-2847585ec671 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:15.034022 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-93efbb31-db16-48db-9628-2847585ec671 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:15.034675 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-93efbb31-db16-48db-9628-2847585ec671 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:15.190662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-93efbb31-db16-48db-9628-2847585ec671 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:15.199059 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-93efbb31-db16-48db-9628-2847585ec671 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:15.200528 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-93efbb31-db16-48db-9628-2847585ec671 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:15.201655 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-93efbb31-db16-48db-9628-2847585ec671 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1733 microversion: 2.20 time: 0.186388 Aug 31 00:41:15.202199 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 407/826] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:15 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1733 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:16.225955 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3cf15465-ee56-49de-a981-387bdb053ed5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:16.227378 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-3cf15465-ee56-49de-a981-387bdb053ed5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:16.234461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3cf15465-ee56-49de-a981-387bdb053ed5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:16.234799 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3cf15465-ee56-49de-a981-387bdb053ed5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:16.235615 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3cf15465-ee56-49de-a981-387bdb053ed5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:16.249208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3cf15465-ee56-49de-a981-387bdb053ed5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:16.249725 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3cf15465-ee56-49de-a981-387bdb053ed5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:16.250266 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3cf15465-ee56-49de-a981-387bdb053ed5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:16.400482 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-3cf15465-ee56-49de-a981-387bdb053ed5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:16.409949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-3cf15465-ee56-49de-a981-387bdb053ed5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:16.411549 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-3cf15465-ee56-49de-a981-387bdb053ed5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:16.413196 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-3cf15465-ee56-49de-a981-387bdb053ed5 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1733 microversion: 2.20 time: 0.191044 Aug 31 00:41:16.413951 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 420/827] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:16 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1733 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:17.440065 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c511a516-2fca-42c2-8443-3f731b5e9168 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:17.444120 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c511a516-2fca-42c2-8443-3f731b5e9168 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:17.449770 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=55 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:17.460415 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c511a516-2fca-42c2-8443-3f731b5e9168 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:17.462007 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c511a516-2fca-42c2-8443-3f731b5e9168 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:17.462007 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c511a516-2fca-42c2-8443-3f731b5e9168 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:17.462210 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c511a516-2fca-42c2-8443-3f731b5e9168 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:17.462656 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c511a516-2fca-42c2-8443-3f731b5e9168 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:17.463078 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c511a516-2fca-42c2-8443-3f731b5e9168 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:17.621079 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c511a516-2fca-42c2-8443-3f731b5e9168 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:17.630510 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c511a516-2fca-42c2-8443-3f731b5e9168 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:17.632133 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c511a516-2fca-42c2-8443-3f731b5e9168 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:17.633435 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-c511a516-2fca-42c2-8443-3f731b5e9168 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1733 microversion: 2.20 time: 0.197925 Aug 31 00:41:17.640902 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 408/828] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:17 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1733 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:18.659214 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-7118680f-3e12-4cb7-a439-02ff81034955 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:18.660282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-7118680f-3e12-4cb7-a439-02ff81034955 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:18.667998 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7118680f-3e12-4cb7-a439-02ff81034955 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:18.668507 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7118680f-3e12-4cb7-a439-02ff81034955 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:18.668943 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7118680f-3e12-4cb7-a439-02ff81034955 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:18.669633 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7118680f-3e12-4cb7-a439-02ff81034955 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:18.670079 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7118680f-3e12-4cb7-a439-02ff81034955 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:18.670495 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7118680f-3e12-4cb7-a439-02ff81034955 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:18.807328 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7118680f-3e12-4cb7-a439-02ff81034955 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:18.816594 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7118680f-3e12-4cb7-a439-02ff81034955 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:18.818574 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7118680f-3e12-4cb7-a439-02ff81034955 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:18.819754 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-7118680f-3e12-4cb7-a439-02ff81034955 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1733 microversion: 2.20 time: 0.165662 Aug 31 00:41:18.820319 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 421/829] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:18 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:19.857232 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-484e83ce-efb3-46a6-8b02-5389a7d02b3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:19.859696 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-484e83ce-efb3-46a6-8b02-5389a7d02b3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:19.870301 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-484e83ce-efb3-46a6-8b02-5389a7d02b3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:19.870886 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-484e83ce-efb3-46a6-8b02-5389a7d02b3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:19.871459 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-484e83ce-efb3-46a6-8b02-5389a7d02b3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:19.872148 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-484e83ce-efb3-46a6-8b02-5389a7d02b3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:19.872645 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-484e83ce-efb3-46a6-8b02-5389a7d02b3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:19.873066 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-484e83ce-efb3-46a6-8b02-5389a7d02b3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:20.036672 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-484e83ce-efb3-46a6-8b02-5389a7d02b3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:20.047277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-484e83ce-efb3-46a6-8b02-5389a7d02b3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:20.049379 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-484e83ce-efb3-46a6-8b02-5389a7d02b3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:20.051450 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-484e83ce-efb3-46a6-8b02-5389a7d02b3e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1733 microversion: 2.20 time: 0.208506 Aug 31 00:41:20.052415 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 409/830] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:19 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1733 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:21.081413 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-39b52617-709f-4b2d-b2f6-b58c4ba41a85 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:21.082071 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-39b52617-709f-4b2d-b2f6-b58c4ba41a85 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:21.090479 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-39b52617-709f-4b2d-b2f6-b58c4ba41a85 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:21.090975 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-39b52617-709f-4b2d-b2f6-b58c4ba41a85 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:21.091465 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-39b52617-709f-4b2d-b2f6-b58c4ba41a85 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:21.092269 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-39b52617-709f-4b2d-b2f6-b58c4ba41a85 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:21.092753 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-39b52617-709f-4b2d-b2f6-b58c4ba41a85 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:21.099497 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-39b52617-709f-4b2d-b2f6-b58c4ba41a85 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:21.250685 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-39b52617-709f-4b2d-b2f6-b58c4ba41a85 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:21.259852 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-39b52617-709f-4b2d-b2f6-b58c4ba41a85 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:21.261346 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-39b52617-709f-4b2d-b2f6-b58c4ba41a85 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:21.262774 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-39b52617-709f-4b2d-b2f6-b58c4ba41a85 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1733 microversion: 2.20 time: 0.185771 Aug 31 00:41:21.263345 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 422/831] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:21 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1733 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:22.288775 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-0293fb9f-b1a5-459c-9f53-2e1073309b61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:22.289659 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-0293fb9f-b1a5-459c-9f53-2e1073309b61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:22.295684 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0293fb9f-b1a5-459c-9f53-2e1073309b61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:22.296172 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0293fb9f-b1a5-459c-9f53-2e1073309b61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:22.296631 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0293fb9f-b1a5-459c-9f53-2e1073309b61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:22.297326 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0293fb9f-b1a5-459c-9f53-2e1073309b61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:22.298105 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0293fb9f-b1a5-459c-9f53-2e1073309b61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:22.298578 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0293fb9f-b1a5-459c-9f53-2e1073309b61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:22.437956 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0293fb9f-b1a5-459c-9f53-2e1073309b61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:22.447490 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0293fb9f-b1a5-459c-9f53-2e1073309b61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:22.448982 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0293fb9f-b1a5-459c-9f53-2e1073309b61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:22.450145 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-0293fb9f-b1a5-459c-9f53-2e1073309b61 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1733 microversion: 2.20 time: 0.166265 Aug 31 00:41:22.451313 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 410/832] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:22 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:23.474560 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-2bb616ea-53bb-4dc3-aa71-8f3885e01fe9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:23.475187 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-2bb616ea-53bb-4dc3-aa71-8f3885e01fe9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:23.482075 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2bb616ea-53bb-4dc3-aa71-8f3885e01fe9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:23.482646 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2bb616ea-53bb-4dc3-aa71-8f3885e01fe9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:23.483154 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2bb616ea-53bb-4dc3-aa71-8f3885e01fe9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:23.483987 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2bb616ea-53bb-4dc3-aa71-8f3885e01fe9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:23.484560 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2bb616ea-53bb-4dc3-aa71-8f3885e01fe9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:23.485047 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2bb616ea-53bb-4dc3-aa71-8f3885e01fe9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:23.651200 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-2bb616ea-53bb-4dc3-aa71-8f3885e01fe9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:23.660741 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-2bb616ea-53bb-4dc3-aa71-8f3885e01fe9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:23.662287 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-2bb616ea-53bb-4dc3-aa71-8f3885e01fe9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:23.663473 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-2bb616ea-53bb-4dc3-aa71-8f3885e01fe9 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1733 microversion: 2.20 time: 0.192947 Aug 31 00:41:23.669850 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 423/833] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:23 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1733 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:24.687456 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-cdb92292-0248-48ee-9a0a-606212f3ed10 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:24.688052 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-cdb92292-0248-48ee-9a0a-606212f3ed10 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:24.694925 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cdb92292-0248-48ee-9a0a-606212f3ed10 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:24.697463 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cdb92292-0248-48ee-9a0a-606212f3ed10 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:24.697463 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cdb92292-0248-48ee-9a0a-606212f3ed10 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:24.697463 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cdb92292-0248-48ee-9a0a-606212f3ed10 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:24.697463 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cdb92292-0248-48ee-9a0a-606212f3ed10 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:24.697893 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cdb92292-0248-48ee-9a0a-606212f3ed10 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:24.839360 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-cdb92292-0248-48ee-9a0a-606212f3ed10 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:24.848023 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-cdb92292-0248-48ee-9a0a-606212f3ed10 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:24.849489 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-cdb92292-0248-48ee-9a0a-606212f3ed10 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:24.850688 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-cdb92292-0248-48ee-9a0a-606212f3ed10 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1733 microversion: 2.20 time: 0.167153 Aug 31 00:41:24.851234 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 411/834] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:24 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:25.873507 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-91083397-c64e-4dc2-b417-d5daddaa338e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:25.874053 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-91083397-c64e-4dc2-b417-d5daddaa338e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:25.880646 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-91083397-c64e-4dc2-b417-d5daddaa338e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:25.881189 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-91083397-c64e-4dc2-b417-d5daddaa338e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:25.881632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-91083397-c64e-4dc2-b417-d5daddaa338e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:25.882334 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-91083397-c64e-4dc2-b417-d5daddaa338e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:25.882779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-91083397-c64e-4dc2-b417-d5daddaa338e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:25.883202 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-91083397-c64e-4dc2-b417-d5daddaa338e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:26.021161 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-91083397-c64e-4dc2-b417-d5daddaa338e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:26.030533 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-91083397-c64e-4dc2-b417-d5daddaa338e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:26.032073 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-91083397-c64e-4dc2-b417-d5daddaa338e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:26.034054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-91083397-c64e-4dc2-b417-d5daddaa338e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1733 microversion: 2.20 time: 0.164485 Aug 31 00:41:26.034693 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 424/835] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:25 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:41:27.057901 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-da91a718-62b7-484c-a110-cb9189de0818 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:27.058513 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-da91a718-62b7-484c-a110-cb9189de0818 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:27.065632 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-da91a718-62b7-484c-a110-cb9189de0818 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:27.066115 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-da91a718-62b7-484c-a110-cb9189de0818 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:27.066539 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-da91a718-62b7-484c-a110-cb9189de0818 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:27.067223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-da91a718-62b7-484c-a110-cb9189de0818 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:27.067670 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-da91a718-62b7-484c-a110-cb9189de0818 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:27.068088 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-da91a718-62b7-484c-a110-cb9189de0818 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:27.458851 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-da91a718-62b7-484c-a110-cb9189de0818 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:27.463284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-da91a718-62b7-484c-a110-cb9189de0818 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:27.464799 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-da91a718-62b7-484c-a110-cb9189de0818 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:27.465952 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-da91a718-62b7-484c-a110-cb9189de0818 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1733 microversion: 2.20 time: 0.411998 Aug 31 00:41:27.466503 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 412/836] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:27 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1733 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:28.489778 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c60c051a-df75-4537-aeb7-fb109ffad2c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:28.490387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c60c051a-df75-4537-aeb7-fb109ffad2c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:28.496541 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c60c051a-df75-4537-aeb7-fb109ffad2c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:28.497024 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c60c051a-df75-4537-aeb7-fb109ffad2c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:28.497458 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c60c051a-df75-4537-aeb7-fb109ffad2c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:28.498205 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c60c051a-df75-4537-aeb7-fb109ffad2c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:28.498655 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c60c051a-df75-4537-aeb7-fb109ffad2c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:28.499079 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c60c051a-df75-4537-aeb7-fb109ffad2c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:28.659415 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-c60c051a-df75-4537-aeb7-fb109ffad2c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:28.671329 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-c60c051a-df75-4537-aeb7-fb109ffad2c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:28.673987 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-c60c051a-df75-4537-aeb7-fb109ffad2c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:28.676006 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c60c051a-df75-4537-aeb7-fb109ffad2c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1733 microversion: 2.20 time: 0.189903 Aug 31 00:41:28.676955 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 425/837] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:28 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1733 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:29.706130 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-b5a1c4c3-7b45-4102-8b85-0eac7b3a8875 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:29.706130 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-b5a1c4c3-7b45-4102-8b85-0eac7b3a8875 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:29.708143 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b5a1c4c3-7b45-4102-8b85-0eac7b3a8875 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:29.708654 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b5a1c4c3-7b45-4102-8b85-0eac7b3a8875 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:29.709079 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b5a1c4c3-7b45-4102-8b85-0eac7b3a8875 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:29.709776 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b5a1c4c3-7b45-4102-8b85-0eac7b3a8875 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:29.710221 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b5a1c4c3-7b45-4102-8b85-0eac7b3a8875 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:29.710634 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b5a1c4c3-7b45-4102-8b85-0eac7b3a8875 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:29.860038 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b5a1c4c3-7b45-4102-8b85-0eac7b3a8875 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:29.869554 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b5a1c4c3-7b45-4102-8b85-0eac7b3a8875 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:29.871042 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b5a1c4c3-7b45-4102-8b85-0eac7b3a8875 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:29.872192 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-b5a1c4c3-7b45-4102-8b85-0eac7b3a8875 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1733 microversion: 2.20 time: 0.175023 Aug 31 00:41:29.872764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 413/838] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:29 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:30.896159 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-737d103b-fbce-44e3-a0a2-f107352cedcc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:30.896791 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-737d103b-fbce-44e3-a0a2-f107352cedcc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:30.903647 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-737d103b-fbce-44e3-a0a2-f107352cedcc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:30.904175 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-737d103b-fbce-44e3-a0a2-f107352cedcc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:30.904646 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-737d103b-fbce-44e3-a0a2-f107352cedcc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:30.905345 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-737d103b-fbce-44e3-a0a2-f107352cedcc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:30.905796 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-737d103b-fbce-44e3-a0a2-f107352cedcc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:30.906215 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-737d103b-fbce-44e3-a0a2-f107352cedcc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:31.003080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-187db6c1-3b20-4a6f-ab44-2a2a9dbb7ab8 req-43300131-7706-4b89-b88c-126e75a3a994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "302d7397-56df-414b-a380-afc6b65fc8fa", "name": "network-vif-plugged", "status": "completed", "tag": "cfcd650e-10f6-464f-a79f-ed420080aea1"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:41:31.013483 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-187db6c1-3b20-4a6f-ab44-2a2a9dbb7ab8 req-43300131-7706-4b89-b88c-126e75a3a994 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:31.018614 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-187db6c1-3b20-4a6f-ab44-2a2a9dbb7ab8 req-43300131-7706-4b89-b88c-126e75a3a994 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:31.018614 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-187db6c1-3b20-4a6f-ab44-2a2a9dbb7ab8 req-43300131-7706-4b89-b88c-126e75a3a994 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:31.027422 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-187db6c1-3b20-4a6f-ab44-2a2a9dbb7ab8 req-43300131-7706-4b89-b88c-126e75a3a994 service nova] Creating event network-vif-plugged:cfcd650e-10f6-464f-a79f-ed420080aea1 for instance 302d7397-56df-414b-a380-afc6b65fc8fa on hv-cinder-85221 Aug 31 00:41:31.032792 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-187db6c1-3b20-4a6f-ab44-2a2a9dbb7ab8 req-43300131-7706-4b89-b88c-126e75a3a994 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033994 Aug 31 00:41:31.033579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 414/839] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:41:31.204669 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-737d103b-fbce-44e3-a0a2-f107352cedcc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:31.213667 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-737d103b-fbce-44e3-a0a2-f107352cedcc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:31.215047 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-737d103b-fbce-44e3-a0a2-f107352cedcc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:31.216219 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-737d103b-fbce-44e3-a0a2-f107352cedcc tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1733 microversion: 2.20 time: 0.325082 Aug 31 00:41:31.216844 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 426/840] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:30 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1733 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:32.241978 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-2414d1cc-09b7-4da5-9f69-f8b6e3f953c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:32.242780 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-2414d1cc-09b7-4da5-9f69-f8b6e3f953c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:32.249711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2414d1cc-09b7-4da5-9f69-f8b6e3f953c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:32.250347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2414d1cc-09b7-4da5-9f69-f8b6e3f953c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:32.250786 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2414d1cc-09b7-4da5-9f69-f8b6e3f953c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:32.251552 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2414d1cc-09b7-4da5-9f69-f8b6e3f953c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:32.252150 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2414d1cc-09b7-4da5-9f69-f8b6e3f953c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:32.252763 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2414d1cc-09b7-4da5-9f69-f8b6e3f953c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:32.387353 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-2414d1cc-09b7-4da5-9f69-f8b6e3f953c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:32.396525 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-2414d1cc-09b7-4da5-9f69-f8b6e3f953c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:32.397967 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-2414d1cc-09b7-4da5-9f69-f8b6e3f953c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:32.399121 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-2414d1cc-09b7-4da5-9f69-f8b6e3f953c0 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1733 microversion: 2.20 time: 0.162662 Aug 31 00:41:32.399993 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 415/841] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:32 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:33.423103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-53bbe594-16f5-4a69-847c-18ee45dc5f59 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:33.424353 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-53bbe594-16f5-4a69-847c-18ee45dc5f59 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:33.433172 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-53bbe594-16f5-4a69-847c-18ee45dc5f59 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:33.438112 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-53bbe594-16f5-4a69-847c-18ee45dc5f59 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:33.438112 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-53bbe594-16f5-4a69-847c-18ee45dc5f59 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:33.438112 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-53bbe594-16f5-4a69-847c-18ee45dc5f59 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:33.438112 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-53bbe594-16f5-4a69-847c-18ee45dc5f59 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:33.438854 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-53bbe594-16f5-4a69-847c-18ee45dc5f59 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:33.578373 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-53bbe594-16f5-4a69-847c-18ee45dc5f59 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:33.591703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-53bbe594-16f5-4a69-847c-18ee45dc5f59 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:33.593216 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-53bbe594-16f5-4a69-847c-18ee45dc5f59 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:33.594404 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-53bbe594-16f5-4a69-847c-18ee45dc5f59 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1733 microversion: 2.20 time: 0.175451 Aug 31 00:41:33.594944 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 427/842] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:33 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1733 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:34.618817 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-5628b356-6cf7-437e-af3e-0499fa4e525a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:34.619376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-5628b356-6cf7-437e-af3e-0499fa4e525a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:34.625783 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5628b356-6cf7-437e-af3e-0499fa4e525a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:34.626267 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5628b356-6cf7-437e-af3e-0499fa4e525a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:34.626752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5628b356-6cf7-437e-af3e-0499fa4e525a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:34.627425 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5628b356-6cf7-437e-af3e-0499fa4e525a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:34.627877 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5628b356-6cf7-437e-af3e-0499fa4e525a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:34.628297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5628b356-6cf7-437e-af3e-0499fa4e525a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:34.768715 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-5628b356-6cf7-437e-af3e-0499fa4e525a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:34.777875 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-5628b356-6cf7-437e-af3e-0499fa4e525a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:34.779363 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-5628b356-6cf7-437e-af3e-0499fa4e525a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:34.780577 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-5628b356-6cf7-437e-af3e-0499fa4e525a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1733 microversion: 2.20 time: 0.165848 Aug 31 00:41:34.781132 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 416/843] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:34 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:41:35.803542 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b84577d6-1e06-404f-80e9-ac3c44073b04 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:35.804079 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-b84577d6-1e06-404f-80e9-ac3c44073b04 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:35.810922 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b84577d6-1e06-404f-80e9-ac3c44073b04 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:35.811411 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b84577d6-1e06-404f-80e9-ac3c44073b04 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:35.811846 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b84577d6-1e06-404f-80e9-ac3c44073b04 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:35.812626 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b84577d6-1e06-404f-80e9-ac3c44073b04 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:35.813010 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b84577d6-1e06-404f-80e9-ac3c44073b04 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:35.813437 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b84577d6-1e06-404f-80e9-ac3c44073b04 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:35.949948 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-b84577d6-1e06-404f-80e9-ac3c44073b04 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:35.958870 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-b84577d6-1e06-404f-80e9-ac3c44073b04 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:35.960336 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-b84577d6-1e06-404f-80e9-ac3c44073b04 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:35.961573 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-b84577d6-1e06-404f-80e9-ac3c44073b04 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1720 microversion: 2.20 time: 0.162392 Aug 31 00:41:35.963212 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 428/844] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:41:35 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:41:42.479136 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-864b3d39-ed3d-497d-85ee-80d064d532b1 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1395928023", "imageRef": "12947ed8-8ca9-442d-9224-509e79a198e7", "flavorRef": "452", "networks": [{"uuid": "7716cd9a-60af-4dcd-981f-cb920802e291"}]}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:41:42.533272 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.network.neutron [None req-864b3d39-ed3d-497d-85ee-80d064d532b1 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] validate_networks() for [('7716cd9a-60af-4dcd-981f-cb920802e291', None, None, None, None, None)] {{(pid=128048) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:41:42.879633 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-864b3d39-ed3d-497d-85ee-80d064d532b1 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Flavor limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:41:42.880053 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-864b3d39-ed3d-497d-85ee-80d064d532b1 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Image limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:41:42.880563 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-864b3d39-ed3d-497d-85ee-80d064d532b1 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Flavor pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:41:42.880973 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-864b3d39-ed3d-497d-85ee-80d064d532b1 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Image pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:41:42.881383 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-864b3d39-ed3d-497d-85ee-80d064d532b1 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:41:42.891043 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-864b3d39-ed3d-497d-85ee-80d064d532b1 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:42.891522 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-864b3d39-ed3d-497d-85ee-80d064d532b1 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:42.891956 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-864b3d39-ed3d-497d-85ee-80d064d532b1 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:42.892710 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-864b3d39-ed3d-497d-85ee-80d064d532b1 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:42.893186 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-864b3d39-ed3d-497d-85ee-80d064d532b1 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:42.893589 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-864b3d39-ed3d-497d-85ee-80d064d532b1 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:42.901570 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:42.911912 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-864b3d39-ed3d-497d-85ee-80d064d532b1 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Getting quotas for project 4f17ea07f4eb4e1e9f875cdb6801b69c. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:41:42.916108 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-864b3d39-ed3d-497d-85ee-80d064d532b1 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Getting quotas for user 4cdee3106dfb469c9b933ae6fa95569c and project 4f17ea07f4eb4e1e9f875cdb6801b69c. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:41:42.929888 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-864b3d39-ed3d-497d-85ee-80d064d532b1 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Going to run 1 instances... {{(pid=128048) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:41:42.930336 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-864b3d39-ed3d-497d-85ee-80d064d532b1 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12947ed8-8ca9-442d-9224-509e79a198e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128048) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:41:43.086214 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-864b3d39-ed3d-497d-85ee-80d064d532b1 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610186 Aug 31 00:41:43.087027 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 417/845] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:41:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:41:43.097781 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-58049f65-4b99-47ba-bd51-c039658f6c3f tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:43.098391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-58049f65-4b99-47ba-bd51-c039658f6c3f tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:43.102480 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:43.155271 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-58049f65-4b99-47ba-bd51-c039658f6c3f tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:43.162227 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-58049f65-4b99-47ba-bd51-c039658f6c3f tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 200 len: 1214 microversion: 2.1 time: 0.068337 Aug 31 00:41:43.162788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 429/846] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:41:43 2022] GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:41:43.489039 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-0c080927-7e45-4812-80df-904964746398 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:43.489645 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-0c080927-7e45-4812-80df-904964746398 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:43.497225 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0c080927-7e45-4812-80df-904964746398 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:43.497722 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0c080927-7e45-4812-80df-904964746398 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:43.498179 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0c080927-7e45-4812-80df-904964746398 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:43.503571 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0c080927-7e45-4812-80df-904964746398 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:43.503571 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0c080927-7e45-4812-80df-904964746398 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:43.503571 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0c080927-7e45-4812-80df-904964746398 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:43.524674 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-0c080927-7e45-4812-80df-904964746398 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/ips" status: 200 len: 150 microversion: 2.1 time: 0.041252 Aug 31 00:41:43.525319 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 418/847] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 00:41:43 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:44.183415 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a8ab30f6-80b0-4abb-84e1-c9de288180db tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:44.184014 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a8ab30f6-80b0-4abb-84e1-c9de288180db tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:44.191636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a8ab30f6-80b0-4abb-84e1-c9de288180db tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:44.192112 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a8ab30f6-80b0-4abb-84e1-c9de288180db tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:44.192573 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a8ab30f6-80b0-4abb-84e1-c9de288180db tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:44.193254 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a8ab30f6-80b0-4abb-84e1-c9de288180db tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:44.193722 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a8ab30f6-80b0-4abb-84e1-c9de288180db tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:44.194141 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a8ab30f6-80b0-4abb-84e1-c9de288180db tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:44.196912 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=67 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:44.260929 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a8ab30f6-80b0-4abb-84e1-c9de288180db tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:44.268241 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a8ab30f6-80b0-4abb-84e1-c9de288180db tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 200 len: 1218 microversion: 2.1 time: 0.088919 Aug 31 00:41:44.268834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 430/848] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:41:44 2022] GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:41:45.077892 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-5f46b237-a8e4-4d15-94ff-47cdfbaa1fdb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9fdf33f-0ba3-4052-aa2e-4027eecb8374"}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:41:45.080505 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-5f46b237-a8e4-4d15-94ff-47cdfbaa1fdb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:45.086831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5f46b237-a8e4-4d15-94ff-47cdfbaa1fdb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:45.087308 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5f46b237-a8e4-4d15-94ff-47cdfbaa1fdb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:45.087740 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5f46b237-a8e4-4d15-94ff-47cdfbaa1fdb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:45.088474 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5f46b237-a8e4-4d15-94ff-47cdfbaa1fdb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:45.089625 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5f46b237-a8e4-4d15-94ff-47cdfbaa1fdb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:45.089980 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5f46b237-a8e4-4d15-94ff-47cdfbaa1fdb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:45.290471 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ccde88de-8e59-4cfb-a900-2152a2bc9224 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:45.291110 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ccde88de-8e59-4cfb-a900-2152a2bc9224 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:45.297982 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ccde88de-8e59-4cfb-a900-2152a2bc9224 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:45.298468 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ccde88de-8e59-4cfb-a900-2152a2bc9224 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:45.298899 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ccde88de-8e59-4cfb-a900-2152a2bc9224 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:45.299614 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ccde88de-8e59-4cfb-a900-2152a2bc9224 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:45.300060 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ccde88de-8e59-4cfb-a900-2152a2bc9224 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:45.300510 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ccde88de-8e59-4cfb-a900-2152a2bc9224 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:45.362177 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ccde88de-8e59-4cfb-a900-2152a2bc9224 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:45.369842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ccde88de-8e59-4cfb-a900-2152a2bc9224 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 200 len: 1266 microversion: 2.1 time: 0.083628 Aug 31 00:41:45.371051 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 431/849] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:41:45 2022] GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:41:45.880123 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-369f5bf2-f84f-4694-b4df-d24be4007af3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:45.881700 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-369f5bf2-f84f-4694-b4df-d24be4007af3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:45.888844 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-369f5bf2-f84f-4694-b4df-d24be4007af3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:45.889340 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-369f5bf2-f84f-4694-b4df-d24be4007af3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:45.889774 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-369f5bf2-f84f-4694-b4df-d24be4007af3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:45.890468 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-369f5bf2-f84f-4694-b4df-d24be4007af3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:45.890914 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-369f5bf2-f84f-4694-b4df-d24be4007af3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:45.891330 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-369f5bf2-f84f-4694-b4df-d24be4007af3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:45.917613 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-369f5bf2-f84f-4694-b4df-d24be4007af3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/ips" status: 200 len: 145 microversion: 2.1 time: 0.218825 Aug 31 00:41:45.918284 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 432/850] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 00:41:45 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/ips => generated 145 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:41:46.197148 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-5f46b237-a8e4-4d15-94ff-47cdfbaa1fdb tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "POST /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.123705 Aug 31 00:41:46.198037 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 419/851] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 00:41:45 2022] POST /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments => generated 194 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:46.392447 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-9076c138-1253-433d-9c7d-40a30cc18688 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:46.393161 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-9076c138-1253-433d-9c7d-40a30cc18688 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:46.400406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9076c138-1253-433d-9c7d-40a30cc18688 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:46.400978 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9076c138-1253-433d-9c7d-40a30cc18688 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:46.402157 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9076c138-1253-433d-9c7d-40a30cc18688 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:46.403333 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9076c138-1253-433d-9c7d-40a30cc18688 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:46.403911 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9076c138-1253-433d-9c7d-40a30cc18688 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:46.404467 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9076c138-1253-433d-9c7d-40a30cc18688 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:46.554826 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-9076c138-1253-433d-9c7d-40a30cc18688 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:46.563141 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-9076c138-1253-433d-9c7d-40a30cc18688 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 200 len: 1314 microversion: 2.1 time: 0.175174 Aug 31 00:41:46.563804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 433/852] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:41:46 2022] GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:41:47.309547 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-f84b4fb1-df43-43bb-a9b3-45958aac79b7 req-5ca8796f-5aa0-4b7a-8ce2-b7c1aea5ae98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0748ded-49cb-4333-818a-1548f3f28de7", "tag": "14c804fc-0aad-4d91-a144-2f4b160e4aa3"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:41:47.321454 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-f84b4fb1-df43-43bb-a9b3-45958aac79b7 req-5ca8796f-5aa0-4b7a-8ce2-b7c1aea5ae98 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:47.322231 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-f84b4fb1-df43-43bb-a9b3-45958aac79b7 req-5ca8796f-5aa0-4b7a-8ce2-b7c1aea5ae98 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:47.322869 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-f84b4fb1-df43-43bb-a9b3-45958aac79b7 req-5ca8796f-5aa0-4b7a-8ce2-b7c1aea5ae98 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:47.335853 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-f84b4fb1-df43-43bb-a9b3-45958aac79b7 req-5ca8796f-5aa0-4b7a-8ce2-b7c1aea5ae98 service nova] Creating event network-changed:14c804fc-0aad-4d91-a144-2f4b160e4aa3 for instance e0748ded-49cb-4333-818a-1548f3f28de7 on hv-cinder-85221 Aug 31 00:41:47.341388 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-f84b4fb1-df43-43bb-a9b3-45958aac79b7 req-5ca8796f-5aa0-4b7a-8ce2-b7c1aea5ae98 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037561 Aug 31 00:41:47.342066 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 420/853] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:47.588483 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c888dcc1-226f-4ac9-8b71-dddae90bebc9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:47.589704 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c888dcc1-226f-4ac9-8b71-dddae90bebc9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:47.591215 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-90853041-976c-4ea8-9bc5-3791f6f35ff3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8496380c-7a46-4a27-9364-12c4536ae8fe"}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:41:47.593689 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-90853041-976c-4ea8-9bc5-3791f6f35ff3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:47.595885 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:47.598544 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c888dcc1-226f-4ac9-8b71-dddae90bebc9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:47.599334 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c888dcc1-226f-4ac9-8b71-dddae90bebc9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:47.600048 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c888dcc1-226f-4ac9-8b71-dddae90bebc9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:47.600970 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-90853041-976c-4ea8-9bc5-3791f6f35ff3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:47.601169 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c888dcc1-226f-4ac9-8b71-dddae90bebc9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:47.601456 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-90853041-976c-4ea8-9bc5-3791f6f35ff3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:47.601984 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c888dcc1-226f-4ac9-8b71-dddae90bebc9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:47.602100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-90853041-976c-4ea8-9bc5-3791f6f35ff3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:47.602693 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-90853041-976c-4ea8-9bc5-3791f6f35ff3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:47.603143 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-90853041-976c-4ea8-9bc5-3791f6f35ff3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:47.603335 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c888dcc1-226f-4ac9-8b71-dddae90bebc9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:47.603568 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-90853041-976c-4ea8-9bc5-3791f6f35ff3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:47.761529 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-c888dcc1-226f-4ac9-8b71-dddae90bebc9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:47.769699 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c888dcc1-226f-4ac9-8b71-dddae90bebc9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 200 len: 1314 microversion: 2.1 time: 0.186436 Aug 31 00:41:47.770279 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 434/854] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:41:47 2022] GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:41:48.351754 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-90853041-976c-4ea8-9bc5-3791f6f35ff3 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "POST /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.764894 Aug 31 00:41:48.357781 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 421/855] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 00:41:47 2022] POST /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments => generated 194 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:41:48.791005 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-68e1919f-4922-4c9a-bab7-ff591fb2e645 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:48.791618 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-68e1919f-4922-4c9a-bab7-ff591fb2e645 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:48.798586 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-68e1919f-4922-4c9a-bab7-ff591fb2e645 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:48.799058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-68e1919f-4922-4c9a-bab7-ff591fb2e645 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:48.799488 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-68e1919f-4922-4c9a-bab7-ff591fb2e645 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:48.800160 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-68e1919f-4922-4c9a-bab7-ff591fb2e645 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:48.800632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-68e1919f-4922-4c9a-bab7-ff591fb2e645 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:48.801048 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-68e1919f-4922-4c9a-bab7-ff591fb2e645 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:48.932432 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-68e1919f-4922-4c9a-bab7-ff591fb2e645 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:48.939160 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-68e1919f-4922-4c9a-bab7-ff591fb2e645 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 200 len: 1314 microversion: 2.1 time: 0.151969 Aug 31 00:41:48.939725 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 435/856] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:41:48 2022] GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:41:49.961718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a053bd9e-9826-4bfa-96e4-13d34223f2fd tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:49.962315 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-a053bd9e-9826-4bfa-96e4-13d34223f2fd tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:49.969637 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a053bd9e-9826-4bfa-96e4-13d34223f2fd tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:49.970115 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a053bd9e-9826-4bfa-96e4-13d34223f2fd tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:49.970545 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a053bd9e-9826-4bfa-96e4-13d34223f2fd tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:49.971230 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a053bd9e-9826-4bfa-96e4-13d34223f2fd tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:49.971683 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a053bd9e-9826-4bfa-96e4-13d34223f2fd tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:49.972146 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a053bd9e-9826-4bfa-96e4-13d34223f2fd tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:50.119062 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-a053bd9e-9826-4bfa-96e4-13d34223f2fd tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:50.127843 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a053bd9e-9826-4bfa-96e4-13d34223f2fd tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 200 len: 1314 microversion: 2.1 time: 0.170564 Aug 31 00:41:50.128450 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 422/857] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:41:49 2022] GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:41:51.151048 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8a5d69d9-6cf3-46f1-a2d2-5f1fa8c1bc29 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:51.151675 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8a5d69d9-6cf3-46f1-a2d2-5f1fa8c1bc29 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:51.158830 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8a5d69d9-6cf3-46f1-a2d2-5f1fa8c1bc29 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:51.159320 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8a5d69d9-6cf3-46f1-a2d2-5f1fa8c1bc29 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:51.159753 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8a5d69d9-6cf3-46f1-a2d2-5f1fa8c1bc29 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:51.160522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8a5d69d9-6cf3-46f1-a2d2-5f1fa8c1bc29 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:51.160981 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8a5d69d9-6cf3-46f1-a2d2-5f1fa8c1bc29 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:51.161386 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8a5d69d9-6cf3-46f1-a2d2-5f1fa8c1bc29 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:51.300313 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8a5d69d9-6cf3-46f1-a2d2-5f1fa8c1bc29 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:51.308021 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8a5d69d9-6cf3-46f1-a2d2-5f1fa8c1bc29 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 200 len: 1314 microversion: 2.1 time: 0.161176 Aug 31 00:41:51.314628 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 436/858] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:41:51 2022] GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:41:52.329887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-cfb07e8b-692c-4cf5-b040-c1762ba24527 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:52.330469 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-cfb07e8b-692c-4cf5-b040-c1762ba24527 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:52.337072 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cfb07e8b-692c-4cf5-b040-c1762ba24527 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:52.337559 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cfb07e8b-692c-4cf5-b040-c1762ba24527 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:52.337992 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cfb07e8b-692c-4cf5-b040-c1762ba24527 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:52.338685 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cfb07e8b-692c-4cf5-b040-c1762ba24527 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:52.339137 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cfb07e8b-692c-4cf5-b040-c1762ba24527 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:52.339560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cfb07e8b-692c-4cf5-b040-c1762ba24527 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:52.482398 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-cfb07e8b-692c-4cf5-b040-c1762ba24527 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:52.493312 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-cfb07e8b-692c-4cf5-b040-c1762ba24527 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 200 len: 1314 microversion: 2.1 time: 0.167278 Aug 31 00:41:52.493875 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 423/859] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:41:52 2022] GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:41:53.233257 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-e96d2b53-cbd4-4dc9-86c6-9aecb6a5ea9f req-41fc42bd-b4e5-44da-83bb-7a82ae6b1eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0748ded-49cb-4333-818a-1548f3f28de7", "name": "network-vif-plugged", "status": "completed", "tag": "14c804fc-0aad-4d91-a144-2f4b160e4aa3"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:41:53.238600 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=2 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:53.243737 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-e96d2b53-cbd4-4dc9-86c6-9aecb6a5ea9f req-41fc42bd-b4e5-44da-83bb-7a82ae6b1eba service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:53.244212 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-e96d2b53-cbd4-4dc9-86c6-9aecb6a5ea9f req-41fc42bd-b4e5-44da-83bb-7a82ae6b1eba service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:53.244706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-e96d2b53-cbd4-4dc9-86c6-9aecb6a5ea9f req-41fc42bd-b4e5-44da-83bb-7a82ae6b1eba service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:53.256480 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-e96d2b53-cbd4-4dc9-86c6-9aecb6a5ea9f req-41fc42bd-b4e5-44da-83bb-7a82ae6b1eba service nova] Creating event network-vif-plugged:14c804fc-0aad-4d91-a144-2f4b160e4aa3 for instance e0748ded-49cb-4333-818a-1548f3f28de7 on hv-cinder-85221 Aug 31 00:41:53.261366 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-e96d2b53-cbd4-4dc9-86c6-9aecb6a5ea9f req-41fc42bd-b4e5-44da-83bb-7a82ae6b1eba service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032360 Aug 31 00:41:53.263223 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 437/860] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:53.515357 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a80619d5-85b1-4660-8e50-51f3207f3fab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:53.515963 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-a80619d5-85b1-4660-8e50-51f3207f3fab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:53.518107 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:53.518775 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=6 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:53.524535 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a80619d5-85b1-4660-8e50-51f3207f3fab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:53.525940 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a80619d5-85b1-4660-8e50-51f3207f3fab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:53.525940 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a80619d5-85b1-4660-8e50-51f3207f3fab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:53.526150 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a80619d5-85b1-4660-8e50-51f3207f3fab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:53.526611 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a80619d5-85b1-4660-8e50-51f3207f3fab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:53.527032 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a80619d5-85b1-4660-8e50-51f3207f3fab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:53.666203 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-a80619d5-85b1-4660-8e50-51f3207f3fab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:53.675579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a80619d5-85b1-4660-8e50-51f3207f3fab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 200 len: 1314 microversion: 2.1 time: 0.164175 Aug 31 00:41:53.676201 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 424/861] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:41:53 2022] GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:41:54.699035 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-83b05f40-5ff8-4294-8954-f5e5507c8000 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:54.699667 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-83b05f40-5ff8-4294-8954-f5e5507c8000 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:54.706217 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-83b05f40-5ff8-4294-8954-f5e5507c8000 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:54.706695 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-83b05f40-5ff8-4294-8954-f5e5507c8000 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:54.707160 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-83b05f40-5ff8-4294-8954-f5e5507c8000 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:54.707841 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-83b05f40-5ff8-4294-8954-f5e5507c8000 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:54.708291 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-83b05f40-5ff8-4294-8954-f5e5507c8000 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:54.708737 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-83b05f40-5ff8-4294-8954-f5e5507c8000 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:54.847590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-83b05f40-5ff8-4294-8954-f5e5507c8000 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:54.857328 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-83b05f40-5ff8-4294-8954-f5e5507c8000 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 200 len: 1314 microversion: 2.1 time: 0.163516 Aug 31 00:41:54.857967 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 438/862] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:41:54 2022] GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:41:54.967316 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-fde81d34-2ac6-49db-b5d7-ce82e8898090 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:54.967881 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-fde81d34-2ac6-49db-b5d7-ce82e8898090 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:54.974807 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fde81d34-2ac6-49db-b5d7-ce82e8898090 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:54.975289 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fde81d34-2ac6-49db-b5d7-ce82e8898090 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:54.975722 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fde81d34-2ac6-49db-b5d7-ce82e8898090 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:54.976454 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fde81d34-2ac6-49db-b5d7-ce82e8898090 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:54.976907 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fde81d34-2ac6-49db-b5d7-ce82e8898090 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:54.977332 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fde81d34-2ac6-49db-b5d7-ce82e8898090 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:55.059558 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-fde81d34-2ac6-49db-b5d7-ce82e8898090 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lazy-loading 'services' on Instance uuid 50bd32a4-8af1-4f25-b417-e99467180ff3 {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:41:55.295271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-fde81d34-2ac6-49db-b5d7-ce82e8898090 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "DELETE /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments/e9fdf33f-0ba3-4052-aa2e-4027eecb8374" status: 202 len: 0 microversion: 2.1 time: 0.331625 Aug 31 00:41:55.296022 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 425/863] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 00:41:54 2022] DELETE /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments/e9fdf33f-0ba3-4052-aa2e-4027eecb8374 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:41:55.305264 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-1e729116-22f5-4e6d-80ac-b1e71a615877 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:55.307486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-1e729116-22f5-4e6d-80ac-b1e71a615877 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:55.313770 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1e729116-22f5-4e6d-80ac-b1e71a615877 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:55.314261 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1e729116-22f5-4e6d-80ac-b1e71a615877 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:55.314725 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1e729116-22f5-4e6d-80ac-b1e71a615877 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:55.315421 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1e729116-22f5-4e6d-80ac-b1e71a615877 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:55.315901 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1e729116-22f5-4e6d-80ac-b1e71a615877 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:55.316349 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1e729116-22f5-4e6d-80ac-b1e71a615877 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:55.347008 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-1e729116-22f5-4e6d-80ac-b1e71a615877 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045890 Aug 31 00:41:55.347552 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 439/864] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:55 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:55.880286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-e7920b7b-f573-472c-8ff6-ae9ae22c0b94 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:55.881005 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-e7920b7b-f573-472c-8ff6-ae9ae22c0b94 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:55.887436 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e7920b7b-f573-472c-8ff6-ae9ae22c0b94 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:55.887923 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e7920b7b-f573-472c-8ff6-ae9ae22c0b94 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:55.888464 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e7920b7b-f573-472c-8ff6-ae9ae22c0b94 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:55.889166 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e7920b7b-f573-472c-8ff6-ae9ae22c0b94 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:55.889619 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e7920b7b-f573-472c-8ff6-ae9ae22c0b94 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:55.890068 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e7920b7b-f573-472c-8ff6-ae9ae22c0b94 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:56.027222 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-e7920b7b-f573-472c-8ff6-ae9ae22c0b94 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:56.034956 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-e7920b7b-f573-472c-8ff6-ae9ae22c0b94 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 200 len: 1314 microversion: 2.1 time: 0.159628 Aug 31 00:41:56.035772 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 426/865] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:41:55 2022] GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:41:56.359642 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4004b543-389f-4451-af6c-313265ba8614 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:56.362391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4004b543-389f-4451-af6c-313265ba8614 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:56.368921 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4004b543-389f-4451-af6c-313265ba8614 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:56.369407 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4004b543-389f-4451-af6c-313265ba8614 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:56.369840 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4004b543-389f-4451-af6c-313265ba8614 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:56.370537 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4004b543-389f-4451-af6c-313265ba8614 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:56.370991 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4004b543-389f-4451-af6c-313265ba8614 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:56.371411 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4004b543-389f-4451-af6c-313265ba8614 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:56.403989 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4004b543-389f-4451-af6c-313265ba8614 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048409 Aug 31 00:41:56.406342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 440/866] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:56 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:57.056633 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-8a11bf94-b06d-46dc-8120-496c37f6a1c4 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:57.057229 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-8a11bf94-b06d-46dc-8120-496c37f6a1c4 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:57.064424 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8a11bf94-b06d-46dc-8120-496c37f6a1c4 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:57.064890 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8a11bf94-b06d-46dc-8120-496c37f6a1c4 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:57.065314 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8a11bf94-b06d-46dc-8120-496c37f6a1c4 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:57.065994 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8a11bf94-b06d-46dc-8120-496c37f6a1c4 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:57.066439 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8a11bf94-b06d-46dc-8120-496c37f6a1c4 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:57.066852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8a11bf94-b06d-46dc-8120-496c37f6a1c4 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:57.197208 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-8a11bf94-b06d-46dc-8120-496c37f6a1c4 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:57.205178 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-8a11bf94-b06d-46dc-8120-496c37f6a1c4 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 200 len: 1499 microversion: 2.1 time: 0.152337 Aug 31 00:41:57.205742 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 427/867] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:41:57 2022] GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 1499 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:41:57.420354 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-5d50ea6f-478e-42d8-8e7b-2be81abec6f5 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:57.423188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-5d50ea6f-478e-42d8-8e7b-2be81abec6f5 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:57.429725 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5d50ea6f-478e-42d8-8e7b-2be81abec6f5 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:57.430382 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5d50ea6f-478e-42d8-8e7b-2be81abec6f5 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:57.435096 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5d50ea6f-478e-42d8-8e7b-2be81abec6f5 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:57.435096 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5d50ea6f-478e-42d8-8e7b-2be81abec6f5 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:57.435096 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5d50ea6f-478e-42d8-8e7b-2be81abec6f5 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:57.435096 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5d50ea6f-478e-42d8-8e7b-2be81abec6f5 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:57.464725 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-5d50ea6f-478e-42d8-8e7b-2be81abec6f5 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051600 Aug 31 00:41:57.469826 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 441/868] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:57 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:58.142354 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-938d7b2f-f382-42a6-bb3b-1bef75919934 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:58.142855 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-938d7b2f-f382-42a6-bb3b-1bef75919934 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:58.149152 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-938d7b2f-f382-42a6-bb3b-1bef75919934 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:58.149881 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-938d7b2f-f382-42a6-bb3b-1bef75919934 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:58.150308 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-938d7b2f-f382-42a6-bb3b-1bef75919934 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:58.150987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-938d7b2f-f382-42a6-bb3b-1bef75919934 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:58.151435 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-938d7b2f-f382-42a6-bb3b-1bef75919934 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:58.151837 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-938d7b2f-f382-42a6-bb3b-1bef75919934 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:58.178918 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-938d7b2f-f382-42a6-bb3b-1bef75919934 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Going to try to terminate instance {{(pid=128048) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:41:58.477790 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f23f12db-a9c4-4b1c-8486-f68815176ffc tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:58.480624 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f23f12db-a9c4-4b1c-8486-f68815176ffc tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:58.487463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f23f12db-a9c4-4b1c-8486-f68815176ffc tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:58.488217 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f23f12db-a9c4-4b1c-8486-f68815176ffc tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:58.488684 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f23f12db-a9c4-4b1c-8486-f68815176ffc tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:58.489390 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f23f12db-a9c4-4b1c-8486-f68815176ffc tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:58.489845 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f23f12db-a9c4-4b1c-8486-f68815176ffc tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:58.490635 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-938d7b2f-f382-42a6-bb3b-1bef75919934 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 204 len: 0 microversion: 2.1 time: 0.352552 Aug 31 00:41:58.490881 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f23f12db-a9c4-4b1c-8486-f68815176ffc tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:58.493580 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 428/869] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:41:58 2022] DELETE /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:41:58.501765 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-38e70a7e-256d-4386-8f1d-eb60888925d6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:58.502424 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-38e70a7e-256d-4386-8f1d-eb60888925d6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:58.508828 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-38e70a7e-256d-4386-8f1d-eb60888925d6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:58.509309 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-38e70a7e-256d-4386-8f1d-eb60888925d6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:58.509742 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-38e70a7e-256d-4386-8f1d-eb60888925d6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:58.510464 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-38e70a7e-256d-4386-8f1d-eb60888925d6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:58.510887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-38e70a7e-256d-4386-8f1d-eb60888925d6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:58.511301 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-38e70a7e-256d-4386-8f1d-eb60888925d6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:58.525195 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f23f12db-a9c4-4b1c-8486-f68815176ffc tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050488 Aug 31 00:41:58.528776 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 442/870] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:58 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:41:58.648174 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-38e70a7e-256d-4386-8f1d-eb60888925d6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:58.655933 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-38e70a7e-256d-4386-8f1d-eb60888925d6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 200 len: 1505 microversion: 2.1 time: 0.160390 Aug 31 00:41:58.658062 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 429/871] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:41:58 2022] GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:41:59.537509 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d26711ea-3c6f-40b0-8245-5e8eb613f76f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:59.539639 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d26711ea-3c6f-40b0-8245-5e8eb613f76f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:59.546328 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d26711ea-3c6f-40b0-8245-5e8eb613f76f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:59.546808 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d26711ea-3c6f-40b0-8245-5e8eb613f76f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:59.547241 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d26711ea-3c6f-40b0-8245-5e8eb613f76f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:59.548013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d26711ea-3c6f-40b0-8245-5e8eb613f76f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:59.548502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d26711ea-3c6f-40b0-8245-5e8eb613f76f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:59.548927 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d26711ea-3c6f-40b0-8245-5e8eb613f76f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:59.579588 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d26711ea-3c6f-40b0-8245-5e8eb613f76f tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045489 Aug 31 00:41:59.580132 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 443/872] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:41:59 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:41:59.677706 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-e1035b3c-3ba5-4221-bda0-7d821942c3ea tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:41:59.678321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-e1035b3c-3ba5-4221-bda0-7d821942c3ea tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:41:59.684746 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e1035b3c-3ba5-4221-bda0-7d821942c3ea tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:59.685231 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e1035b3c-3ba5-4221-bda0-7d821942c3ea tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:59.690684 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e1035b3c-3ba5-4221-bda0-7d821942c3ea tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:59.690684 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e1035b3c-3ba5-4221-bda0-7d821942c3ea tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:41:59.690684 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e1035b3c-3ba5-4221-bda0-7d821942c3ea tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:41:59.690684 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e1035b3c-3ba5-4221-bda0-7d821942c3ea tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:41:59.703274 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:59.823348 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-e1035b3c-3ba5-4221-bda0-7d821942c3ea tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:41:59.831112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-e1035b3c-3ba5-4221-bda0-7d821942c3ea tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 200 len: 1505 microversion: 2.1 time: 0.157272 Aug 31 00:41:59.831672 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 430/873] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:41:59 2022] GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:00.592108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-bf8885ab-2f8f-47b2-b7c8-a73e950844ec tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:00.594336 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-bf8885ab-2f8f-47b2-b7c8-a73e950844ec tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:00.601964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf8885ab-2f8f-47b2-b7c8-a73e950844ec tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:00.602453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf8885ab-2f8f-47b2-b7c8-a73e950844ec tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:00.602887 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf8885ab-2f8f-47b2-b7c8-a73e950844ec tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:00.603589 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf8885ab-2f8f-47b2-b7c8-a73e950844ec tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:00.604035 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf8885ab-2f8f-47b2-b7c8-a73e950844ec tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:00.604481 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bf8885ab-2f8f-47b2-b7c8-a73e950844ec tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:00.636291 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-bf8885ab-2f8f-47b2-b7c8-a73e950844ec tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049132 Aug 31 00:42:00.636877 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 444/874] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:00 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:00.853075 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-6364c225-de36-4a8b-809a-362f6bee627b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:00.853673 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-6364c225-de36-4a8b-809a-362f6bee627b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:00.860360 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6364c225-de36-4a8b-809a-362f6bee627b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:00.861123 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6364c225-de36-4a8b-809a-362f6bee627b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:00.861583 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6364c225-de36-4a8b-809a-362f6bee627b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:00.862291 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6364c225-de36-4a8b-809a-362f6bee627b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:00.862746 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6364c225-de36-4a8b-809a-362f6bee627b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:00.863172 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6364c225-de36-4a8b-809a-362f6bee627b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:01.011708 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-6364c225-de36-4a8b-809a-362f6bee627b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:01.021058 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-6364c225-de36-4a8b-809a-362f6bee627b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 200 len: 1505 microversion: 2.1 time: 0.171775 Aug 31 00:42:01.021790 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 431/875] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:00 2022] GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:01.105445 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-cc1db109-9391-46fb-a4d1-c5e20a05720d req-3689f5bb-3857-4b31-85a8-f38a12c30e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0748ded-49cb-4333-818a-1548f3f28de7", "name": "network-vif-deleted", "tag": "14c804fc-0aad-4d91-a144-2f4b160e4aa3"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:42:01.115216 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-cc1db109-9391-46fb-a4d1-c5e20a05720d req-3689f5bb-3857-4b31-85a8-f38a12c30e2b service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:01.115483 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-cc1db109-9391-46fb-a4d1-c5e20a05720d req-3689f5bb-3857-4b31-85a8-f38a12c30e2b service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:01.115899 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-cc1db109-9391-46fb-a4d1-c5e20a05720d req-3689f5bb-3857-4b31-85a8-f38a12c30e2b service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:01.128038 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-cc1db109-9391-46fb-a4d1-c5e20a05720d req-3689f5bb-3857-4b31-85a8-f38a12c30e2b service nova] Creating event network-vif-deleted:14c804fc-0aad-4d91-a144-2f4b160e4aa3 for instance e0748ded-49cb-4333-818a-1548f3f28de7 on hv-cinder-85221 Aug 31 00:42:01.133094 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-cc1db109-9391-46fb-a4d1-c5e20a05720d req-3689f5bb-3857-4b31-85a8-f38a12c30e2b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031407 Aug 31 00:42:01.133913 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 445/876] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:01.648475 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-25822c27-df6b-436c-8e05-7efbdc730fe9 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:01.651018 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-25822c27-df6b-436c-8e05-7efbdc730fe9 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:01.657578 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-25822c27-df6b-436c-8e05-7efbdc730fe9 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:01.658056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-25822c27-df6b-436c-8e05-7efbdc730fe9 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:01.658484 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-25822c27-df6b-436c-8e05-7efbdc730fe9 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:01.659183 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-25822c27-df6b-436c-8e05-7efbdc730fe9 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:01.659623 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-25822c27-df6b-436c-8e05-7efbdc730fe9 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:01.660038 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-25822c27-df6b-436c-8e05-7efbdc730fe9 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:01.689571 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-25822c27-df6b-436c-8e05-7efbdc730fe9 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045287 Aug 31 00:42:01.690119 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 432/877] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:01 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:42:02.043219 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d282e766-60bd-4419-ac3f-841ff6443a7d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:02.043921 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d282e766-60bd-4419-ac3f-841ff6443a7d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:02.050337 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d282e766-60bd-4419-ac3f-841ff6443a7d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:02.050823 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d282e766-60bd-4419-ac3f-841ff6443a7d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:02.051259 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d282e766-60bd-4419-ac3f-841ff6443a7d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:02.051952 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d282e766-60bd-4419-ac3f-841ff6443a7d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:02.052590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d282e766-60bd-4419-ac3f-841ff6443a7d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:02.052982 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d282e766-60bd-4419-ac3f-841ff6443a7d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:02.086817 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d282e766-60bd-4419-ac3f-841ff6443a7d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:02.087347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d282e766-60bd-4419-ac3f-841ff6443a7d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:02.087846 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d282e766-60bd-4419-ac3f-841ff6443a7d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:02.088301 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-d282e766-60bd-4419-ac3f-841ff6443a7d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lazy-loading 'fault' on Instance uuid e0748ded-49cb-4333-818a-1548f3f28de7 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:42:02.136565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d282e766-60bd-4419-ac3f-841ff6443a7d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:02.154671 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d282e766-60bd-4419-ac3f-841ff6443a7d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 200 len: 1304 microversion: 2.1 time: 0.107913 Aug 31 00:42:02.154671 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 446/878] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:02 2022] GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:02.702013 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-908aa2db-1d9d-488a-8ade-675c0c4861b0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:02.704241 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-908aa2db-1d9d-488a-8ade-675c0c4861b0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:02.711145 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-908aa2db-1d9d-488a-8ade-675c0c4861b0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:02.711749 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-908aa2db-1d9d-488a-8ade-675c0c4861b0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:02.712227 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-908aa2db-1d9d-488a-8ade-675c0c4861b0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:02.712956 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-908aa2db-1d9d-488a-8ade-675c0c4861b0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:02.713404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-908aa2db-1d9d-488a-8ade-675c0c4861b0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:02.713821 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-908aa2db-1d9d-488a-8ade-675c0c4861b0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:02.743862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-908aa2db-1d9d-488a-8ade-675c0c4861b0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045786 Aug 31 00:42:02.744453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 433/879] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:02 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:03.168534 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0d6f9d82-4f1d-4392-86d2-868d0c39e8ab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:03.169317 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-0d6f9d82-4f1d-4392-86d2-868d0c39e8ab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:03.176532 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0d6f9d82-4f1d-4392-86d2-868d0c39e8ab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:03.177018 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0d6f9d82-4f1d-4392-86d2-868d0c39e8ab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:03.177788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0d6f9d82-4f1d-4392-86d2-868d0c39e8ab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:03.178151 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0d6f9d82-4f1d-4392-86d2-868d0c39e8ab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:03.178642 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0d6f9d82-4f1d-4392-86d2-868d0c39e8ab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:03.179065 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0d6f9d82-4f1d-4392-86d2-868d0c39e8ab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:03.211785 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0d6f9d82-4f1d-4392-86d2-868d0c39e8ab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:03.212258 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0d6f9d82-4f1d-4392-86d2-868d0c39e8ab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:03.212718 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0d6f9d82-4f1d-4392-86d2-868d0c39e8ab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:03.213168 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-0d6f9d82-4f1d-4392-86d2-868d0c39e8ab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lazy-loading 'fault' on Instance uuid e0748ded-49cb-4333-818a-1548f3f28de7 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:42:03.259147 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-0d6f9d82-4f1d-4392-86d2-868d0c39e8ab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:03.261883 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=100 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:03.268544 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-0d6f9d82-4f1d-4392-86d2-868d0c39e8ab tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 200 len: 1304 microversion: 2.1 time: 0.103707 Aug 31 00:42:03.269127 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 447/880] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:03 2022] GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:03.368140 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ddfeeca1-2323-4f10-ac8d-077981876b41 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:03.371432 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ddfeeca1-2323-4f10-ac8d-077981876b41 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:03.378375 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ddfeeca1-2323-4f10-ac8d-077981876b41 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:03.378862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ddfeeca1-2323-4f10-ac8d-077981876b41 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:03.379295 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ddfeeca1-2323-4f10-ac8d-077981876b41 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:03.379997 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ddfeeca1-2323-4f10-ac8d-077981876b41 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:03.380487 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ddfeeca1-2323-4f10-ac8d-077981876b41 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:03.380911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ddfeeca1-2323-4f10-ac8d-077981876b41 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:03.413828 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ddfeeca1-2323-4f10-ac8d-077981876b41 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050415 Aug 31 00:42:03.414415 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 434/881] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:03 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:03.425434 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-9859c18d-93e3-40c8-9809-6b08b7da9710 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:03.425916 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-9859c18d-93e3-40c8-9809-6b08b7da9710 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:03.432208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9859c18d-93e3-40c8-9809-6b08b7da9710 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:03.438868 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9859c18d-93e3-40c8-9809-6b08b7da9710 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:03.438868 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9859c18d-93e3-40c8-9809-6b08b7da9710 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:03.438868 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9859c18d-93e3-40c8-9809-6b08b7da9710 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:03.438868 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9859c18d-93e3-40c8-9809-6b08b7da9710 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:03.439311 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9859c18d-93e3-40c8-9809-6b08b7da9710 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:03.464839 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-9859c18d-93e3-40c8-9809-6b08b7da9710 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments/8496380c-7a46-4a27-9364-12c4536ae8fe" status: 200 len: 194 microversion: 2.1 time: 0.043655 Aug 31 00:42:03.468861 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 448/882] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Aug 31 00:42:03 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments/8496380c-7a46-4a27-9364-12c4536ae8fe => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:03.757581 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ab8a5544-5425-409c-8775-689811cc330b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:03.759861 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ab8a5544-5425-409c-8775-689811cc330b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:03.766240 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ab8a5544-5425-409c-8775-689811cc330b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:03.769387 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ab8a5544-5425-409c-8775-689811cc330b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:03.769387 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ab8a5544-5425-409c-8775-689811cc330b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:03.769387 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ab8a5544-5425-409c-8775-689811cc330b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:03.769387 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ab8a5544-5425-409c-8775-689811cc330b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:03.769938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ab8a5544-5425-409c-8775-689811cc330b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:03.805430 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ab8a5544-5425-409c-8775-689811cc330b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052173 Aug 31 00:42:03.806031 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 435/883] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:03 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:42:04.099199 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8840f7ef-7e66-45e4-bf67-71374c84097a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:04.099674 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8840f7ef-7e66-45e4-bf67-71374c84097a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:04.106874 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8840f7ef-7e66-45e4-bf67-71374c84097a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:04.107601 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8840f7ef-7e66-45e4-bf67-71374c84097a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:04.108174 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8840f7ef-7e66-45e4-bf67-71374c84097a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:04.108986 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8840f7ef-7e66-45e4-bf67-71374c84097a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:04.109531 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8840f7ef-7e66-45e4-bf67-71374c84097a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:04.110687 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8840f7ef-7e66-45e4-bf67-71374c84097a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:04.149901 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8840f7ef-7e66-45e4-bf67-71374c84097a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Going to try to terminate instance {{(pid=128049) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:42:04.292535 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-1bdf1eb9-f0fc-495c-ad95-b157ccb52620 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:04.292535 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-1bdf1eb9-f0fc-495c-ad95-b157ccb52620 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: e0748ded-49cb-4333-818a-1548f3f28de7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:04.296898 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1bdf1eb9-f0fc-495c-ad95-b157ccb52620 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:04.297414 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1bdf1eb9-f0fc-495c-ad95-b157ccb52620 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:04.297847 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1bdf1eb9-f0fc-495c-ad95-b157ccb52620 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:04.298924 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1bdf1eb9-f0fc-495c-ad95-b157ccb52620 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:04.299528 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1bdf1eb9-f0fc-495c-ad95-b157ccb52620 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:04.299873 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1bdf1eb9-f0fc-495c-ad95-b157ccb52620 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:04.315765 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-1bdf1eb9-f0fc-495c-ad95-b157ccb52620 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] HTTP exception thrown: Instance e0748ded-49cb-4333-818a-1548f3f28de7 could not be found. Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-1bdf1eb9-f0fc-495c-ad95-b157ccb52620 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Request method failure captured: Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 HTTP/1.1 Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDq5E2Ccv7AWGXMBbz-PqWOgrG1H-_4TxwzKv2GH9Pr15hONcy3wXCvr-9fyCPbcZ2AifFdn-i0iUUuVSCU-h-v8wx_reULXOX_5CfBNCAs_x0KON577lbcQafu0xcmw4mF8TyG2Azr_oZHkeqQGIFNywAA5cs-OhBXlWFF24oGB1g3E Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: 4f17ea07f4eb4e1e9f875cdb6801b69c Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-VolumesActionsTest-1800523304 Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:42:04.317466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:42:04.319061 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f17ea07f4eb4e1e9f875cdb6801b69c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4f17ea07f4eb4e1e9f875cdb6801b69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f17ea07f4eb4e1e9f875cdb6801b69c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4f17ea07f4eb4e1e9f875cdb6801b69c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:04.319061 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-VolumesActionsTest-1800523304 Aug 31 00:42:04.319061 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: 4f17ea07f4eb4e1e9f875cdb6801b69c Aug 31 00:42:04.319061 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-VolumesActionsTest-1800523304 Aug 31 00:42:04.319061 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-VolumesActionsTest-1800523304-project Aug 31 00:42:04.319061 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:42:04.319061 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:42:04.319061 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 4cdee3106dfb469c9b933ae6fa95569c Aug 31 00:42:04.319061 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-VolumesActionsTest-1800523304-project Aug 31 00:42:04.319061 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:42:04.319061 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance e0748ded-49cb-4333-818a-1548f3f28de7 could not be found. Aug 31 00:42:04.319061 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': 'e0748ded-49cb-4333-818a-1548f3f28de7'} Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0748ded-49cb-4333-818a-1548f3f28de7 could not be found. Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:04.319887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:04.321320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:04.321320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:42:04.321320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:42:04.321320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:04.321320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:04.321320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:04.321320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:04.321320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0748ded-49cb-4333-818a-1548f3f28de7 could not be found. Aug 31 00:42:04.321320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:04.321320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:04.321320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:04.321320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:04.321320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:04.321320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:04.321320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:04.321320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:04.321320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0748ded-49cb-4333-818a-1548f3f28de7 could not be found. Aug 31 00:42:04.321320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:04.322417 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-1bdf1eb9-f0fc-495c-ad95-b157ccb52620 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Returning 404 to user: Instance e0748ded-49cb-4333-818a-1548f3f28de7 could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:04.322417 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-1bdf1eb9-f0fc-495c-ad95-b157ccb52620 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7" status: 404 len: 111 microversion: 2.1 time: 0.032840 Aug 31 00:42:04.322417 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 436/884] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:04 2022] GET /compute/v2.1/servers/e0748ded-49cb-4333-818a-1548f3f28de7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:42:04.374623 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-59aadbb5-a298-4bf8-af52-f277c774f900 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-13789773", "imageRef": "12947ed8-8ca9-442d-9224-509e79a198e7", "flavorRef": "452", "networks": [{"uuid": "7716cd9a-60af-4dcd-981f-cb920802e291"}]}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:42:04.432469 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.network.neutron [None req-59aadbb5-a298-4bf8-af52-f277c774f900 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] validate_networks() for [('7716cd9a-60af-4dcd-981f-cb920802e291', None, None, None, None, None)] {{(pid=128048) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:42:04.461692 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8840f7ef-7e66-45e4-bf67-71374c84097a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "DELETE /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 204 len: 0 microversion: 2.1 time: 0.366762 Aug 31 00:42:04.462464 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 449/885] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:42:04 2022] DELETE /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:42:04.477981 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4e3b50d4-fcc8-4c48-89d5-010000c62634 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:04.478714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4e3b50d4-fcc8-4c48-89d5-010000c62634 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:04.485170 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4e3b50d4-fcc8-4c48-89d5-010000c62634 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:04.486038 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4e3b50d4-fcc8-4c48-89d5-010000c62634 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:04.486154 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4e3b50d4-fcc8-4c48-89d5-010000c62634 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:04.487082 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4e3b50d4-fcc8-4c48-89d5-010000c62634 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:04.487670 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4e3b50d4-fcc8-4c48-89d5-010000c62634 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:04.488277 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4e3b50d4-fcc8-4c48-89d5-010000c62634 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:04.631007 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4e3b50d4-fcc8-4c48-89d5-010000c62634 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:04.638967 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4e3b50d4-fcc8-4c48-89d5-010000c62634 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1682 microversion: 2.1 time: 0.165415 Aug 31 00:42:04.639627 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 450/886] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:04 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:04.794824 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-59aadbb5-a298-4bf8-af52-f277c774f900 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Flavor limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:42:04.795338 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-59aadbb5-a298-4bf8-af52-f277c774f900 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Image limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:42:04.795698 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-59aadbb5-a298-4bf8-af52-f277c774f900 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Flavor pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:42:04.796099 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-59aadbb5-a298-4bf8-af52-f277c774f900 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Image pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:42:04.796565 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-59aadbb5-a298-4bf8-af52-f277c774f900 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:42:04.805597 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-59aadbb5-a298-4bf8-af52-f277c774f900 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:04.806079 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-59aadbb5-a298-4bf8-af52-f277c774f900 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:04.806597 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-59aadbb5-a298-4bf8-af52-f277c774f900 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:04.807321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-59aadbb5-a298-4bf8-af52-f277c774f900 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:04.807772 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-59aadbb5-a298-4bf8-af52-f277c774f900 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:04.808195 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-59aadbb5-a298-4bf8-af52-f277c774f900 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:04.825610 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-59aadbb5-a298-4bf8-af52-f277c774f900 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Getting quotas for project 4f17ea07f4eb4e1e9f875cdb6801b69c. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:42:04.829642 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-59aadbb5-a298-4bf8-af52-f277c774f900 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Getting quotas for user 4cdee3106dfb469c9b933ae6fa95569c and project 4f17ea07f4eb4e1e9f875cdb6801b69c. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:42:04.841466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-59aadbb5-a298-4bf8-af52-f277c774f900 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Going to run 1 instances... {{(pid=128048) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:42:04.843929 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-59aadbb5-a298-4bf8-af52-f277c774f900 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12947ed8-8ca9-442d-9224-509e79a198e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128048) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:42:04.978744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-59aadbb5-a298-4bf8-af52-f277c774f900 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608041 Aug 31 00:42:04.979437 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 437/887] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:42:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 00:42:04.991988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-2a50c594-ca00-413c-8d7f-87f97c409e85 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:04.992625 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-2a50c594-ca00-413c-8d7f-87f97c409e85 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:05.046599 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-2a50c594-ca00-413c-8d7f-87f97c409e85 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:05.054454 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-2a50c594-ca00-413c-8d7f-87f97c409e85 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1212 microversion: 2.1 time: 0.067112 Aug 31 00:42:05.055022 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 451/888] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:04 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1212 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:05.194844 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9fd770eb-1619-458c-89ff-10276a5f6ee9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed8d7357-18dc-4f18-b00d-b39e0ef13828"}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:42:05.197208 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9fd770eb-1619-458c-89ff-10276a5f6ee9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:05.203277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9fd770eb-1619-458c-89ff-10276a5f6ee9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:05.203825 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9fd770eb-1619-458c-89ff-10276a5f6ee9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:05.204269 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9fd770eb-1619-458c-89ff-10276a5f6ee9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:05.205087 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9fd770eb-1619-458c-89ff-10276a5f6ee9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:05.205776 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9fd770eb-1619-458c-89ff-10276a5f6ee9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:05.206196 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9fd770eb-1619-458c-89ff-10276a5f6ee9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:05.662427 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d0e4e067-d624-4fd7-bec7-a97a6698e90a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:05.663029 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d0e4e067-d624-4fd7-bec7-a97a6698e90a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:05.669611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0e4e067-d624-4fd7-bec7-a97a6698e90a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:05.670090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0e4e067-d624-4fd7-bec7-a97a6698e90a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:05.670569 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0e4e067-d624-4fd7-bec7-a97a6698e90a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:05.671243 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0e4e067-d624-4fd7-bec7-a97a6698e90a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:05.671689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0e4e067-d624-4fd7-bec7-a97a6698e90a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:05.672098 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d0e4e067-d624-4fd7-bec7-a97a6698e90a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:05.807219 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d0e4e067-d624-4fd7-bec7-a97a6698e90a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:05.819261 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d0e4e067-d624-4fd7-bec7-a97a6698e90a tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1682 microversion: 2.1 time: 0.157305 Aug 31 00:42:05.819261 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 452/889] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:05 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:06.077097 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4270603c-ca3a-4491-99be-ec7737c43130 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:06.077612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4270603c-ca3a-4491-99be-ec7737c43130 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:06.084454 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4270603c-ca3a-4491-99be-ec7737c43130 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:06.084936 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4270603c-ca3a-4491-99be-ec7737c43130 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:06.085363 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4270603c-ca3a-4491-99be-ec7737c43130 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:06.086042 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4270603c-ca3a-4491-99be-ec7737c43130 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:06.086485 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4270603c-ca3a-4491-99be-ec7737c43130 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:06.086905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4270603c-ca3a-4491-99be-ec7737c43130 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:06.149635 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4270603c-ca3a-4491-99be-ec7737c43130 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:06.157284 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4270603c-ca3a-4491-99be-ec7737c43130 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1216 microversion: 2.1 time: 0.084656 Aug 31 00:42:06.157845 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 453/890] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:06 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:06.836870 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4c80564d-4da5-4bfe-8493-27a45f6c3291 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:06.837573 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4c80564d-4da5-4bfe-8493-27a45f6c3291 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:06.844001 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4c80564d-4da5-4bfe-8493-27a45f6c3291 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:06.844522 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4c80564d-4da5-4bfe-8493-27a45f6c3291 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:06.844958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4c80564d-4da5-4bfe-8493-27a45f6c3291 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:06.845645 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4c80564d-4da5-4bfe-8493-27a45f6c3291 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:06.846646 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4c80564d-4da5-4bfe-8493-27a45f6c3291 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:06.847306 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4c80564d-4da5-4bfe-8493-27a45f6c3291 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:06.986407 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4c80564d-4da5-4bfe-8493-27a45f6c3291 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:06.995013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4c80564d-4da5-4bfe-8493-27a45f6c3291 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1682 microversion: 2.1 time: 0.161982 Aug 31 00:42:06.995569 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 454/891] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:06 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:07.178523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8e10d059-e6d1-4d1f-9a2b-926fb765e965 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:07.179072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8e10d059-e6d1-4d1f-9a2b-926fb765e965 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:07.185054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e10d059-e6d1-4d1f-9a2b-926fb765e965 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:07.185536 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e10d059-e6d1-4d1f-9a2b-926fb765e965 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:07.185973 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e10d059-e6d1-4d1f-9a2b-926fb765e965 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:07.186659 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e10d059-e6d1-4d1f-9a2b-926fb765e965 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:07.187109 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e10d059-e6d1-4d1f-9a2b-926fb765e965 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:07.187529 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e10d059-e6d1-4d1f-9a2b-926fb765e965 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:07.248276 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8e10d059-e6d1-4d1f-9a2b-926fb765e965 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:07.256844 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8e10d059-e6d1-4d1f-9a2b-926fb765e965 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1216 microversion: 2.1 time: 0.081926 Aug 31 00:42:07.257512 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 455/892] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:07 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1216 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:08.016762 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-7bc4052a-4702-4cfd-b354-4e60019ae678 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:08.017512 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-7bc4052a-4702-4cfd-b354-4e60019ae678 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:08.025921 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7bc4052a-4702-4cfd-b354-4e60019ae678 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:08.026491 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7bc4052a-4702-4cfd-b354-4e60019ae678 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:08.027028 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7bc4052a-4702-4cfd-b354-4e60019ae678 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:08.027736 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7bc4052a-4702-4cfd-b354-4e60019ae678 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:08.028201 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7bc4052a-4702-4cfd-b354-4e60019ae678 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:08.028643 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7bc4052a-4702-4cfd-b354-4e60019ae678 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:08.176557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7bc4052a-4702-4cfd-b354-4e60019ae678 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:08.185407 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-7bc4052a-4702-4cfd-b354-4e60019ae678 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1682 microversion: 2.1 time: 0.172498 Aug 31 00:42:08.186984 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 456/893] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:08 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:08.279427 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8dc37d10-25d1-451f-94b2-9c47f146ebc2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:08.280057 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8dc37d10-25d1-451f-94b2-9c47f146ebc2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:08.286742 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8dc37d10-25d1-451f-94b2-9c47f146ebc2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:08.287361 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8dc37d10-25d1-451f-94b2-9c47f146ebc2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:08.287917 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8dc37d10-25d1-451f-94b2-9c47f146ebc2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:08.288801 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8dc37d10-25d1-451f-94b2-9c47f146ebc2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:08.289620 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8dc37d10-25d1-451f-94b2-9c47f146ebc2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:08.290291 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8dc37d10-25d1-451f-94b2-9c47f146ebc2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:08.359584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8dc37d10-25d1-451f-94b2-9c47f146ebc2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:08.367764 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8dc37d10-25d1-451f-94b2-9c47f146ebc2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1264 microversion: 2.1 time: 0.092107 Aug 31 00:42:08.368281 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 457/894] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:08 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1264 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:08.432552 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9fd770eb-1619-458c-89ff-10276a5f6ee9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "POST /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.240710 Aug 31 00:42:08.434927 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 438/895] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 00:42:05 2022] POST /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments => generated 194 bytes in 3245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:09.162086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-232c0712-85c0-4495-a635-1b2bae11c94e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:09.165227 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-232c0712-85c0-4495-a635-1b2bae11c94e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:09.172562 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-232c0712-85c0-4495-a635-1b2bae11c94e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:09.173415 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-232c0712-85c0-4495-a635-1b2bae11c94e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:09.174114 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-232c0712-85c0-4495-a635-1b2bae11c94e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:09.176280 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-232c0712-85c0-4495-a635-1b2bae11c94e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:09.177048 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-232c0712-85c0-4495-a635-1b2bae11c94e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:09.178187 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-232c0712-85c0-4495-a635-1b2bae11c94e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:09.215396 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a0be1f1f-02c6-43f0-ae12-79b8a6aa0e76 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:09.231967 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-a0be1f1f-02c6-43f0-ae12-79b8a6aa0e76 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:09.231967 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a0be1f1f-02c6-43f0-ae12-79b8a6aa0e76 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:09.231967 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a0be1f1f-02c6-43f0-ae12-79b8a6aa0e76 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:09.231967 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a0be1f1f-02c6-43f0-ae12-79b8a6aa0e76 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:09.233044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a0be1f1f-02c6-43f0-ae12-79b8a6aa0e76 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:09.233044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a0be1f1f-02c6-43f0-ae12-79b8a6aa0e76 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:09.233044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a0be1f1f-02c6-43f0-ae12-79b8a6aa0e76 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:09.242611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-232c0712-85c0-4495-a635-1b2bae11c94e tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.085254 Aug 31 00:42:09.248800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 458/896] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 31 00:42:09 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:09.344663 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0c5ff3fd-e61d-47ef-bbd0-dc13f21a1ce4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:09.345210 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-0c5ff3fd-e61d-47ef-bbd0-dc13f21a1ce4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:09.357016 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0c5ff3fd-e61d-47ef-bbd0-dc13f21a1ce4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:09.357516 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0c5ff3fd-e61d-47ef-bbd0-dc13f21a1ce4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:09.358001 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0c5ff3fd-e61d-47ef-bbd0-dc13f21a1ce4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:09.358785 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0c5ff3fd-e61d-47ef-bbd0-dc13f21a1ce4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:09.359157 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0c5ff3fd-e61d-47ef-bbd0-dc13f21a1ce4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:09.359821 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0c5ff3fd-e61d-47ef-bbd0-dc13f21a1ce4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:09.389717 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-0c5ff3fd-e61d-47ef-bbd0-dc13f21a1ce4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Going to try to terminate instance {{(pid=128049) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:42:09.404947 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-a0be1f1f-02c6-43f0-ae12-79b8a6aa0e76 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:09.433233 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a0be1f1f-02c6-43f0-ae12-79b8a6aa0e76 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1614 microversion: 2.1 time: 0.228904 Aug 31 00:42:09.442051 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 439/897] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:09 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1614 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:09.461390 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-2162ecd8-2a7e-403c-b2eb-f82b2efb4d57 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:09.462069 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-2162ecd8-2a7e-403c-b2eb-f82b2efb4d57 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:09.482493 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2162ecd8-2a7e-403c-b2eb-f82b2efb4d57 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:09.485038 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2162ecd8-2a7e-403c-b2eb-f82b2efb4d57 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:09.485584 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2162ecd8-2a7e-403c-b2eb-f82b2efb4d57 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:09.486598 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2162ecd8-2a7e-403c-b2eb-f82b2efb4d57 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:09.487065 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2162ecd8-2a7e-403c-b2eb-f82b2efb4d57 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:09.487570 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2162ecd8-2a7e-403c-b2eb-f82b2efb4d57 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:09.599808 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-2162ecd8-2a7e-403c-b2eb-f82b2efb4d57 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:09.614370 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-2162ecd8-2a7e-403c-b2eb-f82b2efb4d57 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1272 microversion: 2.1 time: 0.165867 Aug 31 00:42:09.614370 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 440/898] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:09 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:09.640655 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-e1ada31e-85f7-4e1c-9aca-b70cf4efc512 req-313a0c7f-a323-4279-9061-9bb94b30014d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50bd32a4-8af1-4f25-b417-e99467180ff3", "name": "network-vif-deleted", "tag": "68a3ba26-0475-4d94-9656-0d4d923ff6d1"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:42:09.652831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-e1ada31e-85f7-4e1c-9aca-b70cf4efc512 req-313a0c7f-a323-4279-9061-9bb94b30014d service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:09.653812 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-e1ada31e-85f7-4e1c-9aca-b70cf4efc512 req-313a0c7f-a323-4279-9061-9bb94b30014d service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:09.654593 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-e1ada31e-85f7-4e1c-9aca-b70cf4efc512 req-313a0c7f-a323-4279-9061-9bb94b30014d service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:09.674152 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-e1ada31e-85f7-4e1c-9aca-b70cf4efc512 req-313a0c7f-a323-4279-9061-9bb94b30014d service nova] Creating event network-vif-deleted:68a3ba26-0475-4d94-9656-0d4d923ff6d1 for instance 50bd32a4-8af1-4f25-b417-e99467180ff3 on hv-cinder-85221 Aug 31 00:42:09.681450 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-e1ada31e-85f7-4e1c-9aca-b70cf4efc512 req-313a0c7f-a323-4279-9061-9bb94b30014d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069585 Aug 31 00:42:09.682450 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 441/899] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:09.862057 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-0c5ff3fd-e61d-47ef-bbd0-dc13f21a1ce4 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "DELETE /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 204 len: 0 microversion: 2.20 time: 0.521110 Aug 31 00:42:09.862650 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 459/900] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 31 00:42:09 2022] DELETE /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 31 00:42:09.872576 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a796b06a-4e08-4e70-bcd6-e09441aa2919 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:09.873640 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-a796b06a-4e08-4e70-bcd6-e09441aa2919 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:09.880697 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a796b06a-4e08-4e70-bcd6-e09441aa2919 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:09.882314 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a796b06a-4e08-4e70-bcd6-e09441aa2919 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:09.883039 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a796b06a-4e08-4e70-bcd6-e09441aa2919 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:09.884028 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a796b06a-4e08-4e70-bcd6-e09441aa2919 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:09.884740 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a796b06a-4e08-4e70-bcd6-e09441aa2919 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:09.885413 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a796b06a-4e08-4e70-bcd6-e09441aa2919 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:10.108746 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-a796b06a-4e08-4e70-bcd6-e09441aa2919 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:10.124544 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-a796b06a-4e08-4e70-bcd6-e09441aa2919 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:10.126476 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-a796b06a-4e08-4e70-bcd6-e09441aa2919 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:10.129040 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a796b06a-4e08-4e70-bcd6-e09441aa2919 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1726 microversion: 2.20 time: 0.259949 Aug 31 00:42:10.144538 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 442/901] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:42:09 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1726 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:42:10.461872 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-77e0045e-96a3-4ade-920f-d09fcf867632 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:10.464160 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-77e0045e-96a3-4ade-920f-d09fcf867632 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:10.474372 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-77e0045e-96a3-4ade-920f-d09fcf867632 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:10.475334 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-77e0045e-96a3-4ade-920f-d09fcf867632 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:10.475940 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-77e0045e-96a3-4ade-920f-d09fcf867632 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:10.476856 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-77e0045e-96a3-4ade-920f-d09fcf867632 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:10.479238 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-77e0045e-96a3-4ade-920f-d09fcf867632 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:10.479867 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-77e0045e-96a3-4ade-920f-d09fcf867632 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:10.514052 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f8c15a92-f37c-49d7-a2ee-be808ad5abff tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:10.514610 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-f8c15a92-f37c-49d7-a2ee-be808ad5abff tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:10.523574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f8c15a92-f37c-49d7-a2ee-be808ad5abff tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:10.523778 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-77e0045e-96a3-4ade-920f-d09fcf867632 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:10.524075 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f8c15a92-f37c-49d7-a2ee-be808ad5abff tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:10.524548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-77e0045e-96a3-4ade-920f-d09fcf867632 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:10.524823 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f8c15a92-f37c-49d7-a2ee-be808ad5abff tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:10.524998 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-77e0045e-96a3-4ade-920f-d09fcf867632 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:10.525445 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-77e0045e-96a3-4ade-920f-d09fcf867632 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lazy-loading 'fault' on Instance uuid 50bd32a4-8af1-4f25-b417-e99467180ff3 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:42:10.525572 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f8c15a92-f37c-49d7-a2ee-be808ad5abff tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:10.525969 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f8c15a92-f37c-49d7-a2ee-be808ad5abff tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:10.526381 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f8c15a92-f37c-49d7-a2ee-be808ad5abff tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:10.557472 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-f8c15a92-f37c-49d7-a2ee-be808ad5abff tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Going to try to terminate instance {{(pid=128048) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:42:10.583436 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-77e0045e-96a3-4ade-920f-d09fcf867632 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:10.592656 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-77e0045e-96a3-4ade-920f-d09fcf867632 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1331 microversion: 2.1 time: 0.137017 Aug 31 00:42:10.601798 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 460/902] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:10 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1331 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:10.650997 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-e60785f4-97fe-4b24-a81a-d97f4d3b9884 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:10.652220 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-e60785f4-97fe-4b24-a81a-d97f4d3b9884 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:10.658825 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e60785f4-97fe-4b24-a81a-d97f4d3b9884 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:10.659494 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e60785f4-97fe-4b24-a81a-d97f4d3b9884 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:10.660260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e60785f4-97fe-4b24-a81a-d97f4d3b9884 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:10.661236 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e60785f4-97fe-4b24-a81a-d97f4d3b9884 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:10.661893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e60785f4-97fe-4b24-a81a-d97f4d3b9884 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:10.662530 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e60785f4-97fe-4b24-a81a-d97f4d3b9884 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:10.826615 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-e60785f4-97fe-4b24-a81a-d97f4d3b9884 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:10.832902 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:10.838116 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-e60785f4-97fe-4b24-a81a-d97f4d3b9884 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1312 microversion: 2.1 time: 0.191298 Aug 31 00:42:10.839740 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 461/903] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:10 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:10.947207 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f8c15a92-f37c-49d7-a2ee-be808ad5abff tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 204 len: 0 microversion: 2.1 time: 0.436833 Aug 31 00:42:10.948261 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 443/904] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:42:10 2022] DELETE /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:42:10.959948 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-116c65d5-963e-4c42-8843-9a0f0852d539 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:10.961046 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-116c65d5-963e-4c42-8843-9a0f0852d539 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:10.967591 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-116c65d5-963e-4c42-8843-9a0f0852d539 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:10.968438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-116c65d5-963e-4c42-8843-9a0f0852d539 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:10.969011 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-116c65d5-963e-4c42-8843-9a0f0852d539 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:10.969925 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-116c65d5-963e-4c42-8843-9a0f0852d539 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:10.970479 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-116c65d5-963e-4c42-8843-9a0f0852d539 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:10.971453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-116c65d5-963e-4c42-8843-9a0f0852d539 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:11.122773 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-116c65d5-963e-4c42-8843-9a0f0852d539 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:11.131087 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-116c65d5-963e-4c42-8843-9a0f0852d539 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.177774 Aug 31 00:42:11.131660 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 462/905] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:10 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:11.158424 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-bb498ae7-2f81-4b3c-a19c-6988db98e240 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:11.159034 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-bb498ae7-2f81-4b3c-a19c-6988db98e240 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:11.166117 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bb498ae7-2f81-4b3c-a19c-6988db98e240 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:11.166611 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bb498ae7-2f81-4b3c-a19c-6988db98e240 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:11.167129 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bb498ae7-2f81-4b3c-a19c-6988db98e240 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:11.168192 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bb498ae7-2f81-4b3c-a19c-6988db98e240 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:11.169006 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bb498ae7-2f81-4b3c-a19c-6988db98e240 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:11.169483 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bb498ae7-2f81-4b3c-a19c-6988db98e240 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:11.316303 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-bb498ae7-2f81-4b3c-a19c-6988db98e240 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:11.325298 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-bb498ae7-2f81-4b3c-a19c-6988db98e240 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:11.337294 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-bb498ae7-2f81-4b3c-a19c-6988db98e240 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:11.337294 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-bb498ae7-2f81-4b3c-a19c-6988db98e240 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1726 microversion: 2.20 time: 0.177201 Aug 31 00:42:11.337294 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 444/906] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:42:11 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:42:11.616133 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-82cbdeff-e49b-4388-a5c4-b9ab795515f0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:11.616922 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-82cbdeff-e49b-4388-a5c4-b9ab795515f0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:11.624721 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-82cbdeff-e49b-4388-a5c4-b9ab795515f0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:11.625244 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-82cbdeff-e49b-4388-a5c4-b9ab795515f0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:11.625786 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-82cbdeff-e49b-4388-a5c4-b9ab795515f0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:11.626597 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-82cbdeff-e49b-4388-a5c4-b9ab795515f0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:11.627318 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-82cbdeff-e49b-4388-a5c4-b9ab795515f0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:11.628067 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-82cbdeff-e49b-4388-a5c4-b9ab795515f0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:11.662453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-82cbdeff-e49b-4388-a5c4-b9ab795515f0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:11.662929 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-82cbdeff-e49b-4388-a5c4-b9ab795515f0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:11.663355 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-82cbdeff-e49b-4388-a5c4-b9ab795515f0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:11.663799 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-82cbdeff-e49b-4388-a5c4-b9ab795515f0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lazy-loading 'fault' on Instance uuid 50bd32a4-8af1-4f25-b417-e99467180ff3 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:42:11.707075 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-62301972-e94e-4cc4-ac51-ac79abf4a9f0 req-1b0c0813-99b5-44bf-9ee2-49b4a96b80be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce65669-d807-40a9-95e1-8cb85a0f03c3", "tag": "c18f4b3c-fb43-40d2-901a-6255ea8c3f61"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:42:11.716936 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-62301972-e94e-4cc4-ac51-ac79abf4a9f0 req-1b0c0813-99b5-44bf-9ee2-49b4a96b80be service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:11.717523 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-62301972-e94e-4cc4-ac51-ac79abf4a9f0 req-1b0c0813-99b5-44bf-9ee2-49b4a96b80be service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:11.718041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-62301972-e94e-4cc4-ac51-ac79abf4a9f0 req-1b0c0813-99b5-44bf-9ee2-49b4a96b80be service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:11.726039 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-82cbdeff-e49b-4388-a5c4-b9ab795515f0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:11.731787 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-62301972-e94e-4cc4-ac51-ac79abf4a9f0 req-1b0c0813-99b5-44bf-9ee2-49b4a96b80be service nova] Creating event network-changed:c18f4b3c-fb43-40d2-901a-6255ea8c3f61 for instance bce65669-d807-40a9-95e1-8cb85a0f03c3 on hv-cinder-85221 Aug 31 00:42:11.739730 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-62301972-e94e-4cc4-ac51-ac79abf4a9f0 req-1b0c0813-99b5-44bf-9ee2-49b4a96b80be service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033859 Aug 31 00:42:11.739730 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 445/907] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:11.750461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-82cbdeff-e49b-4388-a5c4-b9ab795515f0 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1331 microversion: 2.1 time: 0.139022 Aug 31 00:42:11.751347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 463/908] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:11 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1331 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:11.860663 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-0ca4bc35-8e9c-483f-a8d0-bdfb591f114d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:11.861360 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-0ca4bc35-8e9c-483f-a8d0-bdfb591f114d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:11.868843 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0ca4bc35-8e9c-483f-a8d0-bdfb591f114d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:11.869332 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0ca4bc35-8e9c-483f-a8d0-bdfb591f114d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:11.869765 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0ca4bc35-8e9c-483f-a8d0-bdfb591f114d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:11.870581 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0ca4bc35-8e9c-483f-a8d0-bdfb591f114d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:11.871017 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0ca4bc35-8e9c-483f-a8d0-bdfb591f114d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:11.871440 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0ca4bc35-8e9c-483f-a8d0-bdfb591f114d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:12.015651 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0ca4bc35-8e9c-483f-a8d0-bdfb591f114d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:12.017962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:12.024934 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-0ca4bc35-8e9c-483f-a8d0-bdfb591f114d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1312 microversion: 2.1 time: 0.168280 Aug 31 00:42:12.025510 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 446/909] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:11 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1312 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:12.126826 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-22a38d51-92ae-4efd-8d20-9698dee479ce req-c2ad7d32-5bdb-4750-ba77-28b70e8573ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42bbab6f-dd9e-4d5d-a854-d2eac6817f5c", "tag": "85ff1e83-3c0f-44de-b1cd-f61df71f6257"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:42:12.136698 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-22a38d51-92ae-4efd-8d20-9698dee479ce req-c2ad7d32-5bdb-4750-ba77-28b70e8573ca service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:12.137174 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-22a38d51-92ae-4efd-8d20-9698dee479ce req-c2ad7d32-5bdb-4750-ba77-28b70e8573ca service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:12.137599 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-22a38d51-92ae-4efd-8d20-9698dee479ce req-c2ad7d32-5bdb-4750-ba77-28b70e8573ca service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:12.149424 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-22a38d51-92ae-4efd-8d20-9698dee479ce req-c2ad7d32-5bdb-4750-ba77-28b70e8573ca service nova] Creating event network-changed:85ff1e83-3c0f-44de-b1cd-f61df71f6257 for instance 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c on hv-cinder-85221 Aug 31 00:42:12.154546 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-22a38d51-92ae-4efd-8d20-9698dee479ce req-c2ad7d32-5bdb-4750-ba77-28b70e8573ca service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031377 Aug 31 00:42:12.155307 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 464/910] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:12.155684 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-70efe6cc-03ec-41a3-bff0-3a54b0c6abd0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:12.156298 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-70efe6cc-03ec-41a3-bff0-3a54b0c6abd0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:12.163768 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70efe6cc-03ec-41a3-bff0-3a54b0c6abd0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:12.164180 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70efe6cc-03ec-41a3-bff0-3a54b0c6abd0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:12.164758 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70efe6cc-03ec-41a3-bff0-3a54b0c6abd0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:12.165590 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70efe6cc-03ec-41a3-bff0-3a54b0c6abd0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:12.166034 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70efe6cc-03ec-41a3-bff0-3a54b0c6abd0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:12.166450 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70efe6cc-03ec-41a3-bff0-3a54b0c6abd0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:12.302092 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-70efe6cc-03ec-41a3-bff0-3a54b0c6abd0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:12.309713 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-70efe6cc-03ec-41a3-bff0-3a54b0c6abd0 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.159203 Aug 31 00:42:12.310325 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 447/911] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:12 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:12.358568 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-bcaf3026-f9fc-4c59-872d-2875d9f6bcf7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:12.359726 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-bcaf3026-f9fc-4c59-872d-2875d9f6bcf7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:12.369067 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bcaf3026-f9fc-4c59-872d-2875d9f6bcf7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:12.369860 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bcaf3026-f9fc-4c59-872d-2875d9f6bcf7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:12.370574 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bcaf3026-f9fc-4c59-872d-2875d9f6bcf7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:12.371710 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bcaf3026-f9fc-4c59-872d-2875d9f6bcf7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:12.372496 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bcaf3026-f9fc-4c59-872d-2875d9f6bcf7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:12.373194 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bcaf3026-f9fc-4c59-872d-2875d9f6bcf7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:12.515541 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-bcaf3026-f9fc-4c59-872d-2875d9f6bcf7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:12.525741 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-bcaf3026-f9fc-4c59-872d-2875d9f6bcf7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:12.527167 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-bcaf3026-f9fc-4c59-872d-2875d9f6bcf7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:12.528344 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-bcaf3026-f9fc-4c59-872d-2875d9f6bcf7 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1726 microversion: 2.20 time: 0.177121 Aug 31 00:42:12.528884 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 465/912] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:42:12 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:42:12.536384 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-6474296c-e8bc-4db4-bc5d-63a61639970d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-614129625", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1773331990", "security_groups": [{"name": "tempest-secgroup-smoke-1046497227"}], "block_device_mapping_v2": [{"uuid": "2fba7fd6-ce5c-4dbd-afd0-4414e412187b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5c79103f-c4fa-4069-a202-b12e6c4f8e87"}]}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:42:12.653149 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.network.neutron [None req-6474296c-e8bc-4db4-bc5d-63a61639970d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] validate_networks() for [('5c79103f-c4fa-4069-a202-b12e6c4f8e87', None, None, None, None, None)] {{(pid=128048) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:42:12.772987 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-e6d50ffa-4660-40ef-b2f7-8c6b103356f3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:12.773601 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-e6d50ffa-4660-40ef-b2f7-8c6b103356f3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:12.780345 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e6d50ffa-4660-40ef-b2f7-8c6b103356f3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:12.780840 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e6d50ffa-4660-40ef-b2f7-8c6b103356f3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:12.781269 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e6d50ffa-4660-40ef-b2f7-8c6b103356f3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:12.782084 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e6d50ffa-4660-40ef-b2f7-8c6b103356f3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:12.782394 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e6d50ffa-4660-40ef-b2f7-8c6b103356f3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:12.782819 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e6d50ffa-4660-40ef-b2f7-8c6b103356f3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:12.812340 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:12.816551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e6d50ffa-4660-40ef-b2f7-8c6b103356f3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:12.817341 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e6d50ffa-4660-40ef-b2f7-8c6b103356f3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:12.817775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e6d50ffa-4660-40ef-b2f7-8c6b103356f3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:12.818309 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-e6d50ffa-4660-40ef-b2f7-8c6b103356f3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lazy-loading 'fault' on Instance uuid 50bd32a4-8af1-4f25-b417-e99467180ff3 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:42:12.861016 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-e6d50ffa-4660-40ef-b2f7-8c6b103356f3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:12.869315 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-e6d50ffa-4660-40ef-b2f7-8c6b103356f3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1331 microversion: 2.1 time: 0.101010 Aug 31 00:42:12.869914 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 466/913] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:12 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:13.040558 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-6474296c-e8bc-4db4-bc5d-63a61639970d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Flavor limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:42:13.041138 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-6474296c-e8bc-4db4-bc5d-63a61639970d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Image limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:42:13.041456 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-6474296c-e8bc-4db4-bc5d-63a61639970d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Flavor pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:42:13.041901 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-6474296c-e8bc-4db4-bc5d-63a61639970d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Image pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:42:13.042315 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-6474296c-e8bc-4db4-bc5d-63a61639970d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:42:13.046906 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-9d848fd0-7fa9-45a0-933e-94af5db8f8b9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:13.047543 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-9d848fd0-7fa9-45a0-933e-94af5db8f8b9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:13.051731 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6474296c-e8bc-4db4-bc5d-63a61639970d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:13.052214 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6474296c-e8bc-4db4-bc5d-63a61639970d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:13.052678 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6474296c-e8bc-4db4-bc5d-63a61639970d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:13.053398 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6474296c-e8bc-4db4-bc5d-63a61639970d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:13.053849 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6474296c-e8bc-4db4-bc5d-63a61639970d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:13.053955 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9d848fd0-7fa9-45a0-933e-94af5db8f8b9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:13.054268 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6474296c-e8bc-4db4-bc5d-63a61639970d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:13.054372 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9d848fd0-7fa9-45a0-933e-94af5db8f8b9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:13.054746 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9d848fd0-7fa9-45a0-933e-94af5db8f8b9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:13.055429 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9d848fd0-7fa9-45a0-933e-94af5db8f8b9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:13.055873 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9d848fd0-7fa9-45a0-933e-94af5db8f8b9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:13.056286 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9d848fd0-7fa9-45a0-933e-94af5db8f8b9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:13.072153 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-6474296c-e8bc-4db4-bc5d-63a61639970d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Getting quotas for project ebe5283d88b44f8b824c7bbca56b3473. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:42:13.076649 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-6474296c-e8bc-4db4-bc5d-63a61639970d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Getting quotas for user 022c4688d9ce4df9a99ae5fa84e1d871 and project ebe5283d88b44f8b824c7bbca56b3473. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:42:13.139711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-6474296c-e8bc-4db4-bc5d-63a61639970d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Going to run 1 instances... {{(pid=128048) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:42:13.141885 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-6474296c-e8bc-4db4-bc5d-63a61639970d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2fba7fd6-ce5c-4dbd-afd0-4414e412187b',volume_size=None,volume_type=None)] {{(pid=128048) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:42:13.195100 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-9d848fd0-7fa9-45a0-933e-94af5db8f8b9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:13.202877 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-9d848fd0-7fa9-45a0-933e-94af5db8f8b9 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1312 microversion: 2.1 time: 0.160226 Aug 31 00:42:13.203489 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 467/914] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:13 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:13.331829 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8e0dfe01-0f32-49f5-a444-d4b1458c42df tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:13.332394 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8e0dfe01-0f32-49f5-a444-d4b1458c42df tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:13.338562 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e0dfe01-0f32-49f5-a444-d4b1458c42df tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:13.339038 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e0dfe01-0f32-49f5-a444-d4b1458c42df tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:13.339496 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e0dfe01-0f32-49f5-a444-d4b1458c42df tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:13.340176 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e0dfe01-0f32-49f5-a444-d4b1458c42df tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:13.340646 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e0dfe01-0f32-49f5-a444-d4b1458c42df tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:13.341067 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8e0dfe01-0f32-49f5-a444-d4b1458c42df tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:13.512025 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8e0dfe01-0f32-49f5-a444-d4b1458c42df tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:13.521680 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8e0dfe01-0f32-49f5-a444-d4b1458c42df tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.193852 Aug 31 00:42:13.522608 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 468/915] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:13 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:13.551747 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a5eb0be4-ede9-424a-b0a2-848f990a25a8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:13.552385 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a5eb0be4-ede9-424a-b0a2-848f990a25a8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:13.558966 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a5eb0be4-ede9-424a-b0a2-848f990a25a8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:13.559461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a5eb0be4-ede9-424a-b0a2-848f990a25a8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:13.559898 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a5eb0be4-ede9-424a-b0a2-848f990a25a8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:13.560636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a5eb0be4-ede9-424a-b0a2-848f990a25a8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:13.561091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a5eb0be4-ede9-424a-b0a2-848f990a25a8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:13.561510 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a5eb0be4-ede9-424a-b0a2-848f990a25a8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:13.583964 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-6474296c-e8bc-4db4-bc5d-63a61639970d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.057753 Aug 31 00:42:13.584568 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 448/916] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:42:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:42:13.596134 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c7ac06b2-b7bb-469f-8785-6710cfe41a2a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:13.596796 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c7ac06b2-b7bb-469f-8785-6710cfe41a2a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:13.611566 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:13.671007 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c7ac06b2-b7bb-469f-8785-6710cfe41a2a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:13.678892 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-c7ac06b2-b7bb-469f-8785-6710cfe41a2a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1094 microversion: 2.1 time: 0.086050 Aug 31 00:42:13.679575 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 449/917] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:13 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:13.740135 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-b9e43705-7817-4654-bb88-0260aa6ab68f req-7aa7cf5a-9715-48c9-bdde-db5e7bd736e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "302d7397-56df-414b-a380-afc6b65fc8fa", "name": "network-vif-unplugged", "status": "completed", "tag": "cfcd650e-10f6-464f-a79f-ed420080aea1"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:42:13.747374 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a5eb0be4-ede9-424a-b0a2-848f990a25a8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:13.753658 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-b9e43705-7817-4654-bb88-0260aa6ab68f req-7aa7cf5a-9715-48c9-bdde-db5e7bd736e3 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:13.754123 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-b9e43705-7817-4654-bb88-0260aa6ab68f req-7aa7cf5a-9715-48c9-bdde-db5e7bd736e3 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:13.754550 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-b9e43705-7817-4654-bb88-0260aa6ab68f req-7aa7cf5a-9715-48c9-bdde-db5e7bd736e3 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:13.758455 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a5eb0be4-ede9-424a-b0a2-848f990a25a8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:13.760653 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a5eb0be4-ede9-424a-b0a2-848f990a25a8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:13.772711 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a5eb0be4-ede9-424a-b0a2-848f990a25a8 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1726 microversion: 2.20 time: 0.224818 Aug 31 00:42:13.774894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 469/918] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:42:13 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1726 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:42:13.781106 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-b9e43705-7817-4654-bb88-0260aa6ab68f req-7aa7cf5a-9715-48c9-bdde-db5e7bd736e3 service nova] Creating event network-vif-unplugged:cfcd650e-10f6-464f-a79f-ed420080aea1 for instance 302d7397-56df-414b-a380-afc6b65fc8fa on hv-cinder-85221 Aug 31 00:42:13.793295 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-b9e43705-7817-4654-bb88-0260aa6ab68f req-7aa7cf5a-9715-48c9-bdde-db5e7bd736e3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059370 Aug 31 00:42:13.794152 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 450/919] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:13.892530 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-9669df01-a7a1-41d0-9cf4-cf9909ca9dcd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:13.893682 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-9669df01-a7a1-41d0-9cf4-cf9909ca9dcd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:13.902383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9669df01-a7a1-41d0-9cf4-cf9909ca9dcd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:13.903393 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9669df01-a7a1-41d0-9cf4-cf9909ca9dcd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:13.904166 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9669df01-a7a1-41d0-9cf4-cf9909ca9dcd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:13.905098 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9669df01-a7a1-41d0-9cf4-cf9909ca9dcd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:13.905634 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9669df01-a7a1-41d0-9cf4-cf9909ca9dcd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:13.906125 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9669df01-a7a1-41d0-9cf4-cf9909ca9dcd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:13.955835 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9669df01-a7a1-41d0-9cf4-cf9909ca9dcd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:13.956262 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9669df01-a7a1-41d0-9cf4-cf9909ca9dcd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:13.956648 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9669df01-a7a1-41d0-9cf4-cf9909ca9dcd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:13.957119 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-9669df01-a7a1-41d0-9cf4-cf9909ca9dcd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lazy-loading 'fault' on Instance uuid 50bd32a4-8af1-4f25-b417-e99467180ff3 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:42:14.040517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-9669df01-a7a1-41d0-9cf4-cf9909ca9dcd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45422a67a78f4784abc0f18ad84778f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5893d9a55f4ed28f6579397d0d6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:14.053830 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-9669df01-a7a1-41d0-9cf4-cf9909ca9dcd tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 200 len: 1331 microversion: 2.1 time: 0.165556 Aug 31 00:42:14.055793 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 470/920] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:13 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 1331 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:14.232227 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-2426b8d8-520e-42ea-95f1-4b4b3266c540 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:14.233140 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-2426b8d8-520e-42ea-95f1-4b4b3266c540 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:14.240599 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2426b8d8-520e-42ea-95f1-4b4b3266c540 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:14.241083 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2426b8d8-520e-42ea-95f1-4b4b3266c540 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:14.241694 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2426b8d8-520e-42ea-95f1-4b4b3266c540 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:14.242393 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2426b8d8-520e-42ea-95f1-4b4b3266c540 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:14.242845 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2426b8d8-520e-42ea-95f1-4b4b3266c540 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:14.243273 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2426b8d8-520e-42ea-95f1-4b4b3266c540 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:14.544086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-fa0cab2a-aa94-4b3e-98ca-e4c8cc72f9ae tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:14.544744 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-fa0cab2a-aa94-4b3e-98ca-e4c8cc72f9ae tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:14.553739 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fa0cab2a-aa94-4b3e-98ca-e4c8cc72f9ae tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:14.560310 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fa0cab2a-aa94-4b3e-98ca-e4c8cc72f9ae tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:14.560808 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fa0cab2a-aa94-4b3e-98ca-e4c8cc72f9ae tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:14.561619 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fa0cab2a-aa94-4b3e-98ca-e4c8cc72f9ae tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:14.562159 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fa0cab2a-aa94-4b3e-98ca-e4c8cc72f9ae tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:14.562511 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fa0cab2a-aa94-4b3e-98ca-e4c8cc72f9ae tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:14.683308 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-2426b8d8-520e-42ea-95f1-4b4b3266c540 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:14.692222 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-2426b8d8-520e-42ea-95f1-4b4b3266c540 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1312 microversion: 2.1 time: 0.465556 Aug 31 00:42:14.705296 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 451/921] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:14 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1312 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:14.715424 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-b956cf49-bc7e-4a59-940e-85add2819be8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:14.716053 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-b956cf49-bc7e-4a59-940e-85add2819be8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:14.724260 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b956cf49-bc7e-4a59-940e-85add2819be8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:14.725749 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b956cf49-bc7e-4a59-940e-85add2819be8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:14.726882 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b956cf49-bc7e-4a59-940e-85add2819be8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:14.728104 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b956cf49-bc7e-4a59-940e-85add2819be8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:14.728643 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b956cf49-bc7e-4a59-940e-85add2819be8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:14.729159 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b956cf49-bc7e-4a59-940e-85add2819be8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:14.755234 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-fa0cab2a-aa94-4b3e-98ca-e4c8cc72f9ae tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:14.766720 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-fa0cab2a-aa94-4b3e-98ca-e4c8cc72f9ae tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1567 microversion: 2.1 time: 0.227091 Aug 31 00:42:14.767432 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 471/922] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:14 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:14.797780 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c29489d4-ceb7-4110-b4e5-c07ed1ee8b13 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:14.798715 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c29489d4-ceb7-4110-b4e5-c07ed1ee8b13 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:14.806773 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c29489d4-ceb7-4110-b4e5-c07ed1ee8b13 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:14.807550 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c29489d4-ceb7-4110-b4e5-c07ed1ee8b13 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:14.808873 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c29489d4-ceb7-4110-b4e5-c07ed1ee8b13 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:14.810578 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c29489d4-ceb7-4110-b4e5-c07ed1ee8b13 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:14.810578 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c29489d4-ceb7-4110-b4e5-c07ed1ee8b13 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:14.810578 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c29489d4-ceb7-4110-b4e5-c07ed1ee8b13 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:14.874406 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b956cf49-bc7e-4a59-940e-85add2819be8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:14.885146 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-b956cf49-bc7e-4a59-940e-85add2819be8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1144 microversion: 2.1 time: 0.176360 Aug 31 00:42:14.885146 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 452/923] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:14 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1144 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:14.957948 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-c29489d4-ceb7-4110-b4e5-c07ed1ee8b13 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:14.968922 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-c29489d4-ceb7-4110-b4e5-c07ed1ee8b13 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:14.970741 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-c29489d4-ceb7-4110-b4e5-c07ed1ee8b13 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:14.972466 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c29489d4-ceb7-4110-b4e5-c07ed1ee8b13 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1726 microversion: 2.20 time: 0.179103 Aug 31 00:42:14.973321 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 472/924] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:42:14 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 00:42:15.078462 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7b2fdc4b-83b2-49a8-805d-6762a8deb189 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:15.079194 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7b2fdc4b-83b2-49a8-805d-6762a8deb189 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:15.087260 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7b2fdc4b-83b2-49a8-805d-6762a8deb189 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:15.087996 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7b2fdc4b-83b2-49a8-805d-6762a8deb189 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:15.088718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7b2fdc4b-83b2-49a8-805d-6762a8deb189 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:15.089550 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7b2fdc4b-83b2-49a8-805d-6762a8deb189 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:15.090003 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7b2fdc4b-83b2-49a8-805d-6762a8deb189 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:15.090424 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7b2fdc4b-83b2-49a8-805d-6762a8deb189 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:15.105709 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-7b2fdc4b-83b2-49a8-805d-6762a8deb189 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] HTTP exception thrown: Instance 50bd32a4-8af1-4f25-b417-e99467180ff3 could not be found. Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7b2fdc4b-83b2-49a8-805d-6762a8deb189 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Request method failure captured: Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 HTTP/1.1 Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDqy7MJOpqb7URH2NMlvnlry7FN8PMqekPyTr4WdpuFP-EJ4P09V7u5pIkcg9D2y64tDq06EhUYjkLoVEA5Xo6OkeLUr7BvIjtmrEoq-poVSUiJYXz83e0U_QXEU4_Gc_m-Y7QkotdhwKhL3RvXqk7a5HcYY_0K_fB-YMAW3D8wMuR_c Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:42:15.107404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:42:15.108972 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:15.108972 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:15.108972 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:42:15.108972 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:15.108972 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:42:15.108972 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:42:15.108972 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:42:15.108972 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 45422a67a78f4784abc0f18ad84778f3 Aug 31 00:42:15.108972 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:42:15.108972 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:42:15.108972 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance 50bd32a4-8af1-4f25-b417-e99467180ff3 could not be found. Aug 31 00:42:15.108972 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': '50bd32a4-8af1-4f25-b417-e99467180ff3'} Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50bd32a4-8af1-4f25-b417-e99467180ff3 could not be found. Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:15.109962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:15.111745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:15.111745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:42:15.111745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:42:15.111745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:15.111745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:15.111745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:15.111745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:15.111745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50bd32a4-8af1-4f25-b417-e99467180ff3 could not be found. Aug 31 00:42:15.111745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:15.111745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:15.111745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:15.111745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:15.111745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:15.111745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:15.111745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:15.111745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:15.111745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50bd32a4-8af1-4f25-b417-e99467180ff3 could not be found. Aug 31 00:42:15.111745 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:15.113474 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7b2fdc4b-83b2-49a8-805d-6762a8deb189 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Returning 404 to user: Instance 50bd32a4-8af1-4f25-b417-e99467180ff3 could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:15.113474 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-7b2fdc4b-83b2-49a8-805d-6762a8deb189 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 404 len: 111 microversion: 2.1 time: 0.034595 Aug 31 00:42:15.113474 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 453/925] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:15 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:15.119833 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-954f4e00-2411-4115-a3db-bdcc6e2642e3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '.version_select at 0x7f551e9d03a0>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:15.125179 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=2 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:15.206150 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-954f4e00-2411-4115-a3db-bdcc6e2642e3 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504529481" status: 202 len: 0 microversion: 2.1 time: 0.090826 Aug 31 00:42:15.207637 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 473/926] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Aug 31 00:42:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504529481 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:42:15.703332 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-1b861b1c-67e2-474e-81e7-a05d18208811 req-924e10ce-a7ed-4f50-8aec-9b2ecd5df90f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce65669-d807-40a9-95e1-8cb85a0f03c3", "name": "network-vif-deleted", "tag": "c18f4b3c-fb43-40d2-901a-6255ea8c3f61"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:42:15.722062 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-1b861b1c-67e2-474e-81e7-a05d18208811 req-924e10ce-a7ed-4f50-8aec-9b2ecd5df90f service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:15.726836 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-1b861b1c-67e2-474e-81e7-a05d18208811 req-924e10ce-a7ed-4f50-8aec-9b2ecd5df90f service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:15.726836 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-1b861b1c-67e2-474e-81e7-a05d18208811 req-924e10ce-a7ed-4f50-8aec-9b2ecd5df90f service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:15.727060 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-491a76cb-51e6-41a8-81e5-3bd9a0bcaee3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:15.727858 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-491a76cb-51e6-41a8-81e5-3bd9a0bcaee3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:15.740256 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-1b861b1c-67e2-474e-81e7-a05d18208811 req-924e10ce-a7ed-4f50-8aec-9b2ecd5df90f service nova] Creating event network-vif-deleted:c18f4b3c-fb43-40d2-901a-6255ea8c3f61 for instance bce65669-d807-40a9-95e1-8cb85a0f03c3 on hv-cinder-85221 Aug 31 00:42:15.751394 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-1b861b1c-67e2-474e-81e7-a05d18208811 req-924e10ce-a7ed-4f50-8aec-9b2ecd5df90f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051781 Aug 31 00:42:15.753408 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 454/927] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:15.760468 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-491a76cb-51e6-41a8-81e5-3bd9a0bcaee3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:15.760468 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-491a76cb-51e6-41a8-81e5-3bd9a0bcaee3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:15.760468 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-491a76cb-51e6-41a8-81e5-3bd9a0bcaee3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:15.760468 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-491a76cb-51e6-41a8-81e5-3bd9a0bcaee3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:15.761311 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-491a76cb-51e6-41a8-81e5-3bd9a0bcaee3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:15.761311 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-491a76cb-51e6-41a8-81e5-3bd9a0bcaee3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:15.797876 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-0fcbc4fe-8dae-4fb9-b657-8658086c95a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:15.798695 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-0fcbc4fe-8dae-4fb9-b657-8658086c95a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:15.809442 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0fcbc4fe-8dae-4fb9-b657-8658086c95a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:15.810478 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0fcbc4fe-8dae-4fb9-b657-8658086c95a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:15.810928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0fcbc4fe-8dae-4fb9-b657-8658086c95a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:15.811759 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0fcbc4fe-8dae-4fb9-b657-8658086c95a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:15.812219 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0fcbc4fe-8dae-4fb9-b657-8658086c95a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:15.812699 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0fcbc4fe-8dae-4fb9-b657-8658086c95a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:15.898574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0fcbc4fe-8dae-4fb9-b657-8658086c95a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:15.907655 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-0fcbc4fe-8dae-4fb9-b657-8658086c95a7 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1381 microversion: 2.1 time: 0.114663 Aug 31 00:42:15.908231 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 455/928] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:15 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1381 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:15.913580 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-76eca104-e634-4452-a59e-9fa703505649 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:15.914446 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-76eca104-e634-4452-a59e-9fa703505649 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:15.923352 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-76eca104-e634-4452-a59e-9fa703505649 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:15.924097 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-76eca104-e634-4452-a59e-9fa703505649 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:15.924731 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-76eca104-e634-4452-a59e-9fa703505649 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:15.940974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-76eca104-e634-4452-a59e-9fa703505649 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:15.940974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-76eca104-e634-4452-a59e-9fa703505649 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:15.940974 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-76eca104-e634-4452-a59e-9fa703505649 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:16.002077 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-76eca104-e634-4452-a59e-9fa703505649 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:16.011318 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-76eca104-e634-4452-a59e-9fa703505649 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1192 microversion: 2.1 time: 0.101587 Aug 31 00:42:16.011893 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 456/929] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:15 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1192 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:16.029557 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-21f7e1fb-2d32-4c47-8500-764868e9cb53 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:16.030167 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-21f7e1fb-2d32-4c47-8500-764868e9cb53 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:16.039461 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-21f7e1fb-2d32-4c47-8500-764868e9cb53 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:16.039673 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-21f7e1fb-2d32-4c47-8500-764868e9cb53 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:16.040103 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-21f7e1fb-2d32-4c47-8500-764868e9cb53 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:16.045058 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-21f7e1fb-2d32-4c47-8500-764868e9cb53 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:16.045749 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-21f7e1fb-2d32-4c47-8500-764868e9cb53 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:16.048296 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-21f7e1fb-2d32-4c47-8500-764868e9cb53 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:16.289117 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-21f7e1fb-2d32-4c47-8500-764868e9cb53 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:16.319006 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-21f7e1fb-2d32-4c47-8500-764868e9cb53 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:16.322297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-21f7e1fb-2d32-4c47-8500-764868e9cb53 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:16.333095 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-21f7e1fb-2d32-4c47-8500-764868e9cb53 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1658 microversion: 2.20 time: 0.309280 Aug 31 00:42:16.337019 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 457/930] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:42:16 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1658 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:42:16.354623 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-491a76cb-51e6-41a8-81e5-3bd9a0bcaee3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:16.393141 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-491a76cb-51e6-41a8-81e5-3bd9a0bcaee3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1312 microversion: 2.1 time: 0.675461 Aug 31 00:42:16.410925 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 474/931] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:15 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1312 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:16.931663 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a0fc7d4e-67af-4b8e-9501-ec8556d40fe2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:16.932584 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-a0fc7d4e-67af-4b8e-9501-ec8556d40fe2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:16.939550 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a0fc7d4e-67af-4b8e-9501-ec8556d40fe2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:16.940016 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a0fc7d4e-67af-4b8e-9501-ec8556d40fe2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:16.945702 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a0fc7d4e-67af-4b8e-9501-ec8556d40fe2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:16.945702 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a0fc7d4e-67af-4b8e-9501-ec8556d40fe2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:16.945702 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a0fc7d4e-67af-4b8e-9501-ec8556d40fe2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:16.945702 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a0fc7d4e-67af-4b8e-9501-ec8556d40fe2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:17.015248 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-a0fc7d4e-67af-4b8e-9501-ec8556d40fe2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:17.026195 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a0fc7d4e-67af-4b8e-9501-ec8556d40fe2 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1218 microversion: 2.1 time: 0.097847 Aug 31 00:42:17.026895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 458/932] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:16 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:17.046290 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4768b984-0cfd-4240-b3f5-5d03832cfe20 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:17.047093 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4768b984-0cfd-4240-b3f5-5d03832cfe20 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:17.053944 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4768b984-0cfd-4240-b3f5-5d03832cfe20 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:17.054477 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4768b984-0cfd-4240-b3f5-5d03832cfe20 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:17.055315 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4768b984-0cfd-4240-b3f5-5d03832cfe20 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:17.056049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4768b984-0cfd-4240-b3f5-5d03832cfe20 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:17.057893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4768b984-0cfd-4240-b3f5-5d03832cfe20 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:17.057893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4768b984-0cfd-4240-b3f5-5d03832cfe20 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:17.126672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4768b984-0cfd-4240-b3f5-5d03832cfe20 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:17.136652 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4768b984-0cfd-4240-b3f5-5d03832cfe20 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1192 microversion: 2.1 time: 0.094965 Aug 31 00:42:17.146232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 475/933] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:17 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:17.254090 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-96d0edbf-de41-4aeb-8fa7-ee6284ae2e26 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:17.256378 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-96d0edbf-de41-4aeb-8fa7-ee6284ae2e26 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:17.262767 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-96d0edbf-de41-4aeb-8fa7-ee6284ae2e26 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:17.263275 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-96d0edbf-de41-4aeb-8fa7-ee6284ae2e26 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:17.263727 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-96d0edbf-de41-4aeb-8fa7-ee6284ae2e26 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:17.264467 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-96d0edbf-de41-4aeb-8fa7-ee6284ae2e26 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:17.264919 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-96d0edbf-de41-4aeb-8fa7-ee6284ae2e26 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:17.265330 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-96d0edbf-de41-4aeb-8fa7-ee6284ae2e26 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:17.297287 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-96d0edbf-de41-4aeb-8fa7-ee6284ae2e26 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047386 Aug 31 00:42:17.297862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 459/934] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:17 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:17.366675 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-18f7a3b1-2944-4277-8f7c-2758ceb18f5d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:17.367287 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-18f7a3b1-2944-4277-8f7c-2758ceb18f5d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:17.373672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-18f7a3b1-2944-4277-8f7c-2758ceb18f5d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:17.374160 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-18f7a3b1-2944-4277-8f7c-2758ceb18f5d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:17.374598 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-18f7a3b1-2944-4277-8f7c-2758ceb18f5d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:17.375315 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-18f7a3b1-2944-4277-8f7c-2758ceb18f5d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:17.375775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-18f7a3b1-2944-4277-8f7c-2758ceb18f5d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:17.376197 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-18f7a3b1-2944-4277-8f7c-2758ceb18f5d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:17.408118 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-18f7a3b1-2944-4277-8f7c-2758ceb18f5d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:17.408662 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-18f7a3b1-2944-4277-8f7c-2758ceb18f5d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:17.409104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-18f7a3b1-2944-4277-8f7c-2758ceb18f5d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:17.409559 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-18f7a3b1-2944-4277-8f7c-2758ceb18f5d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lazy-loading 'fault' on Instance uuid 302d7397-56df-414b-a380-afc6b65fc8fa {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:42:17.410704 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-fa69d09d-30fc-4a95-ac67-615dcba59b2c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:17.411189 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-fa69d09d-30fc-4a95-ac67-615dcba59b2c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:17.418970 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fa69d09d-30fc-4a95-ac67-615dcba59b2c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:17.419703 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fa69d09d-30fc-4a95-ac67-615dcba59b2c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:17.420374 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fa69d09d-30fc-4a95-ac67-615dcba59b2c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:17.421085 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fa69d09d-30fc-4a95-ac67-615dcba59b2c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:17.421556 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fa69d09d-30fc-4a95-ac67-615dcba59b2c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:17.421968 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fa69d09d-30fc-4a95-ac67-615dcba59b2c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:17.455538 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-fa69d09d-30fc-4a95-ac67-615dcba59b2c tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments/8496380c-7a46-4a27-9364-12c4536ae8fe" status: 200 len: 194 microversion: 2.1 time: 0.048833 Aug 31 00:42:17.456193 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 460/935] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Aug 31 00:42:17 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments/8496380c-7a46-4a27-9364-12c4536ae8fe => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:42:17.460916 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-18f7a3b1-2944-4277-8f7c-2758ceb18f5d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:17.466591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-110ddbff-9968-4706-ab5f-cb371e69460d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:17.467200 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-110ddbff-9968-4706-ab5f-cb371e69460d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:17.470088 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-18f7a3b1-2944-4277-8f7c-2758ceb18f5d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:17.471616 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-18f7a3b1-2944-4277-8f7c-2758ceb18f5d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:17.472857 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-18f7a3b1-2944-4277-8f7c-2758ceb18f5d tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1372 microversion: 2.20 time: 0.110150 Aug 31 00:42:17.473251 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-110ddbff-9968-4706-ab5f-cb371e69460d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:17.473636 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 476/936] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:42:17 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:42:17.473774 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-110ddbff-9968-4706-ab5f-cb371e69460d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:17.474170 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-110ddbff-9968-4706-ab5f-cb371e69460d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:17.474925 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-110ddbff-9968-4706-ab5f-cb371e69460d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:17.475497 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-110ddbff-9968-4706-ab5f-cb371e69460d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:17.475921 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-110ddbff-9968-4706-ab5f-cb371e69460d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:17.479357 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-955186a4-65e3-4e20-897f-bbc4d740ccd6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:17.480431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-955186a4-65e3-4e20-897f-bbc4d740ccd6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:17.486331 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-955186a4-65e3-4e20-897f-bbc4d740ccd6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:17.486818 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-955186a4-65e3-4e20-897f-bbc4d740ccd6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:17.487259 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-955186a4-65e3-4e20-897f-bbc4d740ccd6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:17.487954 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-955186a4-65e3-4e20-897f-bbc4d740ccd6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:17.488710 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-955186a4-65e3-4e20-897f-bbc4d740ccd6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:17.489284 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-955186a4-65e3-4e20-897f-bbc4d740ccd6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:17.592489 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-955186a4-65e3-4e20-897f-bbc4d740ccd6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lazy-loading 'services' on Instance uuid bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:42:17.636235 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-110ddbff-9968-4706-ab5f-cb371e69460d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:17.649810 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-110ddbff-9968-4706-ab5f-cb371e69460d tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1312 microversion: 2.1 time: 0.183448 Aug 31 00:42:17.649810 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 461/937] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:17 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1312 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:17.769341 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-5d50b70b-61df-4d00-9c52-b79d47b46fa9 req-f43b7958-0d20-4ce4-bf1c-e7ef006bc1da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "302d7397-56df-414b-a380-afc6b65fc8fa", "name": "network-vif-deleted", "tag": "cfcd650e-10f6-464f-a79f-ed420080aea1"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:42:17.779813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-5d50b70b-61df-4d00-9c52-b79d47b46fa9 req-f43b7958-0d20-4ce4-bf1c-e7ef006bc1da service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:17.780219 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-5d50b70b-61df-4d00-9c52-b79d47b46fa9 req-f43b7958-0d20-4ce4-bf1c-e7ef006bc1da service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:17.780729 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-5d50b70b-61df-4d00-9c52-b79d47b46fa9 req-f43b7958-0d20-4ce4-bf1c-e7ef006bc1da service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:17.791995 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-5d50b70b-61df-4d00-9c52-b79d47b46fa9 req-f43b7958-0d20-4ce4-bf1c-e7ef006bc1da service nova] Creating event network-vif-deleted:cfcd650e-10f6-464f-a79f-ed420080aea1 for instance 302d7397-56df-414b-a380-afc6b65fc8fa on hv-cinder-85221 Aug 31 00:42:17.796858 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-5d50b70b-61df-4d00-9c52-b79d47b46fa9 req-f43b7958-0d20-4ce4-bf1c-e7ef006bc1da service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031378 Aug 31 00:42:17.797441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 462/938] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:42:17.836873 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-955186a4-65e3-4e20-897f-bbc4d740ccd6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments/8496380c-7a46-4a27-9364-12c4536ae8fe" status: 202 len: 0 microversion: 2.1 time: 0.361741 Aug 31 00:42:17.837451 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 477/939] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 00:42:17 2022] DELETE /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments/8496380c-7a46-4a27-9364-12c4536ae8fe => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:42:18.049083 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-0d4c1f99-cd9a-443f-99c8-a03730e55533 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:18.049781 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-0d4c1f99-cd9a-443f-99c8-a03730e55533 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:18.058575 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0d4c1f99-cd9a-443f-99c8-a03730e55533 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:18.059834 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0d4c1f99-cd9a-443f-99c8-a03730e55533 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:18.060226 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0d4c1f99-cd9a-443f-99c8-a03730e55533 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:18.061123 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0d4c1f99-cd9a-443f-99c8-a03730e55533 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:18.061779 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0d4c1f99-cd9a-443f-99c8-a03730e55533 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:18.062002 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0d4c1f99-cd9a-443f-99c8-a03730e55533 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:18.113128 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b37d0f16-5e5b-41e8-bfec-0a6cd75b9f44 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:18.114266 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-b37d0f16-5e5b-41e8-bfec-0a6cd75b9f44 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:18.114947 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0d4c1f99-cd9a-443f-99c8-a03730e55533 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:18.115435 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0d4c1f99-cd9a-443f-99c8-a03730e55533 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:18.116973 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0d4c1f99-cd9a-443f-99c8-a03730e55533 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:18.117824 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-0d4c1f99-cd9a-443f-99c8-a03730e55533 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lazy-loading 'fault' on Instance uuid bce65669-d807-40a9-95e1-8cb85a0f03c3 {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:42:18.122983 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b37d0f16-5e5b-41e8-bfec-0a6cd75b9f44 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:18.124282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b37d0f16-5e5b-41e8-bfec-0a6cd75b9f44 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:18.125156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b37d0f16-5e5b-41e8-bfec-0a6cd75b9f44 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:18.126149 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b37d0f16-5e5b-41e8-bfec-0a6cd75b9f44 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:18.127161 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b37d0f16-5e5b-41e8-bfec-0a6cd75b9f44 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:18.129209 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b37d0f16-5e5b-41e8-bfec-0a6cd75b9f44 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:18.150861 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:18.153240 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-b37d0f16-5e5b-41e8-bfec-0a6cd75b9f44 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] HTTP exception thrown: Instance 50bd32a4-8af1-4f25-b417-e99467180ff3 could not be found. Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b37d0f16-5e5b-41e8-bfec-0a6cd75b9f44 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Request method failure captured: Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: DELETE /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 HTTP/1.1 Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqy7MJOpqb7URH2NMlvnlry7FN8PMqekPyTr4WdpuFP-EJ4P09V7u5pIkcg9D2y64tDq06EhUYjkLoVEA5Xo6OkeLUr7BvIjtmrEoq-poVSUiJYXz83e0U_QXEU4_Gc_m-Y7QkotdhwKhL3RvXqk7a5HcYY_0K_fB-YMAW3D8wMuR_c Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:42:18.155800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:42:18.157265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:18.157265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:18.157265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:42:18.157265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:18.157265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:42:18.157265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:42:18.157265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:42:18.157265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 45422a67a78f4784abc0f18ad84778f3 Aug 31 00:42:18.157265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:42:18.157265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:42:18.157265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance 50bd32a4-8af1-4f25-b417-e99467180ff3 could not be found. Aug 31 00:42:18.157265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': '50bd32a4-8af1-4f25-b417-e99467180ff3'} Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50bd32a4-8af1-4f25-b417-e99467180ff3 could not be found. Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:18.158314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50bd32a4-8af1-4f25-b417-e99467180ff3 could not be found. Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50bd32a4-8af1-4f25-b417-e99467180ff3 could not be found. Aug 31 00:42:18.159708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:18.162165 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b37d0f16-5e5b-41e8-bfec-0a6cd75b9f44 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Returning 404 to user: Instance 50bd32a4-8af1-4f25-b417-e99467180ff3 could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:18.163113 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-b37d0f16-5e5b-41e8-bfec-0a6cd75b9f44 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "DELETE /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 404 len: 111 microversion: 2.1 time: 0.054585 Aug 31 00:42:18.163891 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 478/940] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:42:18 2022] DELETE /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:18.171256 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0d4c1f99-cd9a-443f-99c8-a03730e55533 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:18.171764 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ed53d97b-45ff-4ff0-a55e-820ebd81e1fe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:18.172499 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ed53d97b-45ff-4ff0-a55e-820ebd81e1fe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:18.179140 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ed53d97b-45ff-4ff0-a55e-820ebd81e1fe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:18.179625 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ed53d97b-45ff-4ff0-a55e-820ebd81e1fe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:18.180053 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ed53d97b-45ff-4ff0-a55e-820ebd81e1fe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:18.180448 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-0d4c1f99-cd9a-443f-99c8-a03730e55533 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1223 microversion: 2.1 time: 0.136271 Aug 31 00:42:18.180899 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ed53d97b-45ff-4ff0-a55e-820ebd81e1fe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:18.181542 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 463/941] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:18 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1223 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:18.181775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ed53d97b-45ff-4ff0-a55e-820ebd81e1fe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:18.182363 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ed53d97b-45ff-4ff0-a55e-820ebd81e1fe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:18.193868 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-86d5fe9b-5d12-44fa-94e4-bc7298a78565 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:18.194786 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-86d5fe9b-5d12-44fa-94e4-bc7298a78565 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 50bd32a4-8af1-4f25-b417-e99467180ff3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:18.202135 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-86d5fe9b-5d12-44fa-94e4-bc7298a78565 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:18.202643 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-86d5fe9b-5d12-44fa-94e4-bc7298a78565 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:18.203089 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-86d5fe9b-5d12-44fa-94e4-bc7298a78565 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:18.203775 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-86d5fe9b-5d12-44fa-94e4-bc7298a78565 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:18.204222 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-86d5fe9b-5d12-44fa-94e4-bc7298a78565 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:18.204667 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-86d5fe9b-5d12-44fa-94e4-bc7298a78565 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:18.219360 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-86d5fe9b-5d12-44fa-94e4-bc7298a78565 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] HTTP exception thrown: Instance 50bd32a4-8af1-4f25-b417-e99467180ff3 could not be found. Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-86d5fe9b-5d12-44fa-94e4-bc7298a78565 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Request method failure captured: Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 HTTP/1.1 Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDqy7MJOpqb7URH2NMlvnlry7FN8PMqekPyTr4WdpuFP-EJ4P09V7u5pIkcg9D2y64tDq06EhUYjkLoVEA5Xo6OkeLUr7BvIjtmrEoq-poVSUiJYXz83e0U_QXEU4_Gc_m-Y7QkotdhwKhL3RvXqk7a5HcYY_0K_fB-YMAW3D8wMuR_c Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:42:18.221080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:42:18.222433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:18.222433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:18.222433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:42:18.222433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:18.222433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:42:18.222433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:42:18.222433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:42:18.222433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 45422a67a78f4784abc0f18ad84778f3 Aug 31 00:42:18.222433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:42:18.222433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:42:18.222433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance 50bd32a4-8af1-4f25-b417-e99467180ff3 could not be found. Aug 31 00:42:18.222433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': '50bd32a4-8af1-4f25-b417-e99467180ff3'} Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50bd32a4-8af1-4f25-b417-e99467180ff3 could not be found. Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:18.223596 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:18.224911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:18.224911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:42:18.224911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:42:18.224911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:18.224911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:18.224911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:18.224911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:18.224911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50bd32a4-8af1-4f25-b417-e99467180ff3 could not be found. Aug 31 00:42:18.224911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:18.224911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:18.224911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:18.224911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:18.224911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:18.224911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:18.224911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:18.224911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:18.224911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50bd32a4-8af1-4f25-b417-e99467180ff3 could not be found. Aug 31 00:42:18.224911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:18.226062 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-86d5fe9b-5d12-44fa-94e4-bc7298a78565 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Returning 404 to user: Instance 50bd32a4-8af1-4f25-b417-e99467180ff3 could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:18.226062 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-86d5fe9b-5d12-44fa-94e4-bc7298a78565 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3" status: 404 len: 111 microversion: 2.1 time: 0.033213 Aug 31 00:42:18.226062 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 464/942] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:18 2022] GET /compute/v2.1/servers/50bd32a4-8af1-4f25-b417-e99467180ff3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:18.251853 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ed53d97b-45ff-4ff0-a55e-820ebd81e1fe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:18.261986 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ed53d97b-45ff-4ff0-a55e-820ebd81e1fe tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1192 microversion: 2.1 time: 0.094065 Aug 31 00:42:18.262553 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 479/943] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:18 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1192 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:18.498089 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-24ea3cb9-cfc8-4510-b530-2be56ae65117 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:18.498678 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-24ea3cb9-cfc8-4510-b530-2be56ae65117 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:18.505080 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-24ea3cb9-cfc8-4510-b530-2be56ae65117 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:18.505558 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-24ea3cb9-cfc8-4510-b530-2be56ae65117 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:18.506183 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-24ea3cb9-cfc8-4510-b530-2be56ae65117 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:18.506907 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-24ea3cb9-cfc8-4510-b530-2be56ae65117 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:18.507368 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-24ea3cb9-cfc8-4510-b530-2be56ae65117 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:18.507793 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-24ea3cb9-cfc8-4510-b530-2be56ae65117 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:18.542179 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-24ea3cb9-cfc8-4510-b530-2be56ae65117 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:18.542660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-24ea3cb9-cfc8-4510-b530-2be56ae65117 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:18.543096 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-24ea3cb9-cfc8-4510-b530-2be56ae65117 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:18.543540 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-24ea3cb9-cfc8-4510-b530-2be56ae65117 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lazy-loading 'fault' on Instance uuid 302d7397-56df-414b-a380-afc6b65fc8fa {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:42:18.588971 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-24ea3cb9-cfc8-4510-b530-2be56ae65117 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:18.596992 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-24ea3cb9-cfc8-4510-b530-2be56ae65117 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:18.598435 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-24ea3cb9-cfc8-4510-b530-2be56ae65117 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a927401086b4a649919a6071b4a0fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606c24bee18a4454ab672cfb6a395286', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:18.599567 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-24ea3cb9-cfc8-4510-b530-2be56ae65117 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 200 len: 1372 microversion: 2.20 time: 0.105924 Aug 31 00:42:18.600110 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 465/944] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:42:18 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 00:42:18.668251 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-01602e1c-259f-434e-9b3c-8d918ad2f441 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:18.668885 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-01602e1c-259f-434e-9b3c-8d918ad2f441 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:18.675422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-01602e1c-259f-434e-9b3c-8d918ad2f441 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:18.675901 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-01602e1c-259f-434e-9b3c-8d918ad2f441 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:18.676342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-01602e1c-259f-434e-9b3c-8d918ad2f441 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:18.677040 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-01602e1c-259f-434e-9b3c-8d918ad2f441 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:18.677487 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-01602e1c-259f-434e-9b3c-8d918ad2f441 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:18.683318 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-01602e1c-259f-434e-9b3c-8d918ad2f441 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:18.820885 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-01602e1c-259f-434e-9b3c-8d918ad2f441 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:18.830438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-01602e1c-259f-434e-9b3c-8d918ad2f441 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1312 microversion: 2.1 time: 0.166105 Aug 31 00:42:18.831162 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 480/945] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:18 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:19.203388 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-e2a36727-9da0-4abf-b753-bddb8d1b2808 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:19.204067 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-e2a36727-9da0-4abf-b753-bddb8d1b2808 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:19.211732 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e2a36727-9da0-4abf-b753-bddb8d1b2808 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.213114 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e2a36727-9da0-4abf-b753-bddb8d1b2808 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.213689 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e2a36727-9da0-4abf-b753-bddb8d1b2808 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.214478 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e2a36727-9da0-4abf-b753-bddb8d1b2808 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.214928 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e2a36727-9da0-4abf-b753-bddb8d1b2808 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.215347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e2a36727-9da0-4abf-b753-bddb8d1b2808 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.247070 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e2a36727-9da0-4abf-b753-bddb8d1b2808 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.247539 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e2a36727-9da0-4abf-b753-bddb8d1b2808 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.247967 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e2a36727-9da0-4abf-b753-bddb8d1b2808 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.248429 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-e2a36727-9da0-4abf-b753-bddb8d1b2808 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lazy-loading 'fault' on Instance uuid bce65669-d807-40a9-95e1-8cb85a0f03c3 {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:42:19.285607 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a166a752-21a9-426f-9a35-107901f6905d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:19.285607 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a166a752-21a9-426f-9a35-107901f6905d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:19.291403 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a166a752-21a9-426f-9a35-107901f6905d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.291956 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a166a752-21a9-426f-9a35-107901f6905d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.292485 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a166a752-21a9-426f-9a35-107901f6905d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.292605 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-e2a36727-9da0-4abf-b753-bddb8d1b2808 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639977b5f6744b9939d1e5a9745cd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f0cda364854dfd9fde0249a751ecf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:19.293186 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a166a752-21a9-426f-9a35-107901f6905d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.293661 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a166a752-21a9-426f-9a35-107901f6905d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.294080 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a166a752-21a9-426f-9a35-107901f6905d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.310829 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-e2a36727-9da0-4abf-b753-bddb8d1b2808 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 200 len: 1223 microversion: 2.1 time: 0.111076 Aug 31 00:42:19.318855 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 466/946] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:19 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 1223 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:19.385429 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a166a752-21a9-426f-9a35-107901f6905d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:19.405265 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a166a752-21a9-426f-9a35-107901f6905d tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1210 microversion: 2.1 time: 0.125500 Aug 31 00:42:19.405853 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 481/947] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:19 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1210 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:19.546600 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d3ca1c3a-d1cf-4a76-903e-33d79b46896b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:19.547095 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d3ca1c3a-d1cf-4a76-903e-33d79b46896b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:19.557899 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d3ca1c3a-d1cf-4a76-903e-33d79b46896b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.557899 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d3ca1c3a-d1cf-4a76-903e-33d79b46896b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.557899 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d3ca1c3a-d1cf-4a76-903e-33d79b46896b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.557899 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d3ca1c3a-d1cf-4a76-903e-33d79b46896b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.558727 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d3ca1c3a-d1cf-4a76-903e-33d79b46896b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.558727 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d3ca1c3a-d1cf-4a76-903e-33d79b46896b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.571182 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-d3ca1c3a-d1cf-4a76-903e-33d79b46896b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] HTTP exception thrown: Instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd could not be found. Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d3ca1c3a-d1cf-4a76-903e-33d79b46896b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Request method failure captured: Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: DELETE /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd HTTP/1.1 Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDqy7MJOpqb7URH2NMlvnlry7FN8PMqekPyTr4WdpuFP-EJ4P09V7u5pIkcg9D2y64tDq06EhUYjkLoVEA5Xo6OkeLUr7BvIjtmrEoq-poVSUiJYXz83e0U_QXEU4_Gc_m-Y7QkotdhwKhL3RvXqk7a5HcYY_0K_fB-YMAW3D8wMuR_c Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:42:19.573591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:42:19.581347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:19.581347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:19.581347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:42:19.581347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:19.581347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:42:19.581347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:42:19.581347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:42:19.581347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 45422a67a78f4784abc0f18ad84778f3 Aug 31 00:42:19.581347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:42:19.581347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:42:19.581347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd could not be found. Aug 31 00:42:19.581347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': '24bd8f41-5ce3-4260-bd3e-d98a55817bfd'} Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd could not be found. Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:19.582223 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd could not be found. Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd could not be found. Aug 31 00:42:19.583650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.585216 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d3ca1c3a-d1cf-4a76-903e-33d79b46896b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Returning 404 to user: Instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:19.585216 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d3ca1c3a-d1cf-4a76-903e-33d79b46896b tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "DELETE /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 404 len: 111 microversion: 2.1 time: 0.032212 Aug 31 00:42:19.585216 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 467/948] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:42:19 2022] DELETE /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:19.585458 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b97a7ff6-5ce4-4f83-859c-af108da51601 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:19.585458 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-b97a7ff6-5ce4-4f83-859c-af108da51601 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 24bd8f41-5ce3-4260-bd3e-d98a55817bfd] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:19.591220 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b97a7ff6-5ce4-4f83-859c-af108da51601 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.591702 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b97a7ff6-5ce4-4f83-859c-af108da51601 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.592137 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b97a7ff6-5ce4-4f83-859c-af108da51601 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.592860 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b97a7ff6-5ce4-4f83-859c-af108da51601 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.593340 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b97a7ff6-5ce4-4f83-859c-af108da51601 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.593761 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b97a7ff6-5ce4-4f83-859c-af108da51601 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.609798 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-b97a7ff6-5ce4-4f83-859c-af108da51601 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] HTTP exception thrown: Instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd could not be found. Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b97a7ff6-5ce4-4f83-859c-af108da51601 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Request method failure captured: Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd HTTP/1.1 Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqy7MJOpqb7URH2NMlvnlry7FN8PMqekPyTr4WdpuFP-EJ4P09V7u5pIkcg9D2y64tDq06EhUYjkLoVEA5Xo6OkeLUr7BvIjtmrEoq-poVSUiJYXz83e0U_QXEU4_Gc_m-Y7QkotdhwKhL3RvXqk7a5HcYY_0K_fB-YMAW3D8wMuR_c Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:42:19.611387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:42:19.612970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:19.612970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:19.612970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:42:19.612970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:19.612970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:42:19.612970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:42:19.612970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:42:19.612970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 45422a67a78f4784abc0f18ad84778f3 Aug 31 00:42:19.612970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:42:19.612970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:42:19.612970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd could not be found. Aug 31 00:42:19.612970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': '24bd8f41-5ce3-4260-bd3e-d98a55817bfd'} Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd could not be found. Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:19.613876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:19.615453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:19.615453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:42:19.615453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:42:19.615453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:19.615453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:19.615453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:19.615453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:19.615453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd could not be found. Aug 31 00:42:19.615453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.615453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:19.615453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.615453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:19.615453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:19.615453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:19.615453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:19.615453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:19.615453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd could not be found. Aug 31 00:42:19.615453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.617163 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b97a7ff6-5ce4-4f83-859c-af108da51601 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Returning 404 to user: Instance 24bd8f41-5ce3-4260-bd3e-d98a55817bfd could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:19.617163 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-b97a7ff6-5ce4-4f83-859c-af108da51601 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd" status: 404 len: 111 microversion: 2.1 time: 0.033460 Aug 31 00:42:19.617163 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 482/949] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:19 2022] GET /compute/v2.1/servers/24bd8f41-5ce3-4260-bd3e-d98a55817bfd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:19.623805 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7dbfa357-950e-4e12-a6a0-1df46c4c3e17 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:19.625064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7dbfa357-950e-4e12-a6a0-1df46c4c3e17 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:19.631801 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-e83fcc79-e04d-4cdc-b294-a510fbab3f69 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:19.632972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-e83fcc79-e04d-4cdc-b294-a510fbab3f69 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:19.634059 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7dbfa357-950e-4e12-a6a0-1df46c4c3e17 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.635654 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7dbfa357-950e-4e12-a6a0-1df46c4c3e17 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.636316 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7dbfa357-950e-4e12-a6a0-1df46c4c3e17 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.637240 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7dbfa357-950e-4e12-a6a0-1df46c4c3e17 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.638608 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7dbfa357-950e-4e12-a6a0-1df46c4c3e17 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.639293 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7dbfa357-950e-4e12-a6a0-1df46c4c3e17 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.641434 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e83fcc79-e04d-4cdc-b294-a510fbab3f69 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.642177 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e83fcc79-e04d-4cdc-b294-a510fbab3f69 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.642784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e83fcc79-e04d-4cdc-b294-a510fbab3f69 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.643614 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e83fcc79-e04d-4cdc-b294-a510fbab3f69 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.644121 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e83fcc79-e04d-4cdc-b294-a510fbab3f69 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.644970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e83fcc79-e04d-4cdc-b294-a510fbab3f69 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.645310 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=100 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:19.664520 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-7dbfa357-950e-4e12-a6a0-1df46c4c3e17 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] HTTP exception thrown: Instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc could not be found. Aug 31 00:42:19.665933 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-e83fcc79-e04d-4cdc-b294-a510fbab3f69 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] HTTP exception thrown: Instance 302d7397-56df-414b-a380-afc6b65fc8fa could not be found. Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-e83fcc79-e04d-4cdc-b294-a510fbab3f69 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Request method failure captured: Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa HTTP/1.1 Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqy5VUB-5vypeDrL9KyCtyy2DyyS5WzgA3UmCKlzAVIbXiUyGwtNVKH4YdoT43FxVSPzB7q3qaWOdTbrhgpdvz9RHCjhxPCeLGhp5RRsc3mvVYG2xmERbClJhrObqW-PqS5mvLReqxJb9XnQ-nSdy0f8YpzQvsj6A3VB2qOFnuuWu98 Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: 606c24bee18a4454ab672cfb6a395286 Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1045984733 Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:42:19.667557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:42:19.673490 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/606c24bee18a4454ab672cfb6a395286"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/606c24bee18a4454ab672cfb6a395286"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/606c24bee18a4454ab672cfb6a395286"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_606c24bee18a4454ab672cfb6a395286"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:19.673490 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1045984733 Aug 31 00:42:19.673490 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: 606c24bee18a4454ab672cfb6a395286 Aug 31 00:42:19.673490 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1045984733 Aug 31 00:42:19.673490 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-AttachVolumeShelveTestJSON-1045984733-project Aug 31 00:42:19.673490 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:42:19.673490 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:42:19.673490 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 2a927401086b4a649919a6071b4a0fd9 Aug 31 00:42:19.673490 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1045984733-project Aug 31 00:42:19.673490 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:42:19.673490 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance 302d7397-56df-414b-a380-afc6b65fc8fa could not be found. Aug 31 00:42:19.673490 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': '302d7397-56df-414b-a380-afc6b65fc8fa'} Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 302d7397-56df-414b-a380-afc6b65fc8fa could not be found. Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:19.674977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:19.676486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:19.676486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:42:19.676486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:42:19.676486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:19.676486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:19.676486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:19.676486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:19.676486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 302d7397-56df-414b-a380-afc6b65fc8fa could not be found. Aug 31 00:42:19.676486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.676486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:19.676486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.676486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:19.676486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:19.676486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:19.676486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:19.676486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:19.676486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 302d7397-56df-414b-a380-afc6b65fc8fa could not be found. Aug 31 00:42:19.676486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.677748 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-e83fcc79-e04d-4cdc-b294-a510fbab3f69 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Returning 404 to user: Instance 302d7397-56df-414b-a380-afc6b65fc8fa could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:19.677748 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-e83fcc79-e04d-4cdc-b294-a510fbab3f69 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 404 len: 111 microversion: 2.20 time: 0.043367 Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7dbfa357-950e-4e12-a6a0-1df46c4c3e17 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Request method failure captured: Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: DELETE /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc HTTP/1.1 Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDqy7MJOpqb7URH2NMlvnlry7FN8PMqekPyTr4WdpuFP-EJ4P09V7u5pIkcg9D2y64tDq06EhUYjkLoVEA5Xo6OkeLUr7BvIjtmrEoq-poVSUiJYXz83e0U_QXEU4_Gc_m-Y7QkotdhwKhL3RvXqk7a5HcYY_0K_fB-YMAW3D8wMuR_c Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:42:19.678163 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:42:19.679718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:19.679718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:19.679718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:42:19.679718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:19.679718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:42:19.679718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:42:19.679718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:42:19.679718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 45422a67a78f4784abc0f18ad84778f3 Aug 31 00:42:19.679718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:42:19.679718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:42:19.679718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc could not be found. Aug 31 00:42:19.679718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': '514a5573-d33c-4d96-bf91-d3b6e21c09dc'} Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc could not be found. Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:19.680579 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc could not be found. Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc could not be found. Aug 31 00:42:19.682962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.684421 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7dbfa357-950e-4e12-a6a0-1df46c4c3e17 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Returning 404 to user: Instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:19.684421 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-7dbfa357-950e-4e12-a6a0-1df46c4c3e17 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "DELETE /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 404 len: 111 microversion: 2.1 time: 0.053355 Aug 31 00:42:19.684421 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 468/950] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:42:19 2022] DELETE /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:19.684685 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 483/951] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:42:19 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:42:19.684777 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-e7aaac79-dfb3-4233-a64f-a65a16ee9b2c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '.version_select at 0x7f55223ba820>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:19.687582 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-186ef93b-5ad0-4a27-ba5a-17783fe6c9e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:19.688984 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-186ef93b-5ad0-4a27-ba5a-17783fe6c9e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 514a5573-d33c-4d96-bf91-d3b6e21c09dc] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:19.696474 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-186ef93b-5ad0-4a27-ba5a-17783fe6c9e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.697899 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-186ef93b-5ad0-4a27-ba5a-17783fe6c9e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.698405 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-186ef93b-5ad0-4a27-ba5a-17783fe6c9e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.699983 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-186ef93b-5ad0-4a27-ba5a-17783fe6c9e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.700387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-186ef93b-5ad0-4a27-ba5a-17783fe6c9e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.701038 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-186ef93b-5ad0-4a27-ba5a-17783fe6c9e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.721035 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-186ef93b-5ad0-4a27-ba5a-17783fe6c9e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] HTTP exception thrown: Instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc could not be found. Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-186ef93b-5ad0-4a27-ba5a-17783fe6c9e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Request method failure captured: Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc HTTP/1.1 Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqy7MJOpqb7URH2NMlvnlry7FN8PMqekPyTr4WdpuFP-EJ4P09V7u5pIkcg9D2y64tDq06EhUYjkLoVEA5Xo6OkeLUr7BvIjtmrEoq-poVSUiJYXz83e0U_QXEU4_Gc_m-Y7QkotdhwKhL3RvXqk7a5HcYY_0K_fB-YMAW3D8wMuR_c Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:42:19.722964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:42:19.724268 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:19.724268 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:19.724268 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:42:19.724268 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:19.724268 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:42:19.724268 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:42:19.724268 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:42:19.724268 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 45422a67a78f4784abc0f18ad84778f3 Aug 31 00:42:19.724268 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:42:19.724268 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:42:19.724268 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc could not be found. Aug 31 00:42:19.724268 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': '514a5573-d33c-4d96-bf91-d3b6e21c09dc'} Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc could not be found. Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:19.725017 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:19.727406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:19.727406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:42:19.727406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:42:19.727406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:19.727406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:19.727406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:19.727406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:19.727406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc could not be found. Aug 31 00:42:19.727406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.727406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:19.727406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.727406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:19.727406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:19.727406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:19.727406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:19.727406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:19.727406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc could not be found. Aug 31 00:42:19.727406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:19.738005 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-186ef93b-5ad0-4a27-ba5a-17783fe6c9e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Returning 404 to user: Instance 514a5573-d33c-4d96-bf91-d3b6e21c09dc could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:19.738005 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-186ef93b-5ad0-4a27-ba5a-17783fe6c9e6 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc" status: 404 len: 111 microversion: 2.1 time: 0.051671 Aug 31 00:42:19.738005 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 484/952] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:19 2022] GET /compute/v2.1/servers/514a5573-d33c-4d96-bf91-d3b6e21c09dc => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:19.769364 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-e7aaac79-dfb3-4233-a64f-a65a16ee9b2c tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473017074" status: 204 len: 0 microversion: 2.20 time: 0.092964 Aug 31 00:42:19.770276 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 469/953] 10.222.0.65 () {60 vars in 1262 bytes} [Wed Aug 31 00:42:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473017074 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 00:42:19.851286 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-00aba503-b95c-4256-93cc-8b5e0c5f3228 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:19.852127 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-00aba503-b95c-4256-93cc-8b5e0c5f3228 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:19.872514 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-00aba503-b95c-4256-93cc-8b5e0c5f3228 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.875266 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-00aba503-b95c-4256-93cc-8b5e0c5f3228 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.875266 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-00aba503-b95c-4256-93cc-8b5e0c5f3228 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:19.875266 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-00aba503-b95c-4256-93cc-8b5e0c5f3228 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:19.875792 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-00aba503-b95c-4256-93cc-8b5e0c5f3228 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:19.876455 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-00aba503-b95c-4256-93cc-8b5e0c5f3228 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:20.066996 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-4411009c-dcd8-44d9-8bfb-491eef7bdcf6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:20.069468 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-4411009c-dcd8-44d9-8bfb-491eef7bdcf6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:20.081518 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4411009c-dcd8-44d9-8bfb-491eef7bdcf6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:20.082416 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4411009c-dcd8-44d9-8bfb-491eef7bdcf6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:20.083008 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4411009c-dcd8-44d9-8bfb-491eef7bdcf6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:20.084434 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4411009c-dcd8-44d9-8bfb-491eef7bdcf6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:20.085126 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4411009c-dcd8-44d9-8bfb-491eef7bdcf6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:20.085836 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4411009c-dcd8-44d9-8bfb-491eef7bdcf6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:20.124023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-00aba503-b95c-4256-93cc-8b5e0c5f3228 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:20.132933 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-00aba503-b95c-4256-93cc-8b5e0c5f3228 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1312 microversion: 2.1 time: 0.285379 Aug 31 00:42:20.133120 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-4411009c-dcd8-44d9-8bfb-491eef7bdcf6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments/ed8d7357-18dc-4f18-b00d-b39e0ef13828" status: 200 len: 194 microversion: 2.1 time: 0.077469 Aug 31 00:42:20.133551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 485/954] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:19 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1312 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:20.136489 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 470/955] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Aug 31 00:42:20 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments/ed8d7357-18dc-4f18-b00d-b39e0ef13828 => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:20.153277 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-fcfd0f3a-36de-4680-8ff7-cdf5d093e3ee tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:20.153935 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-fcfd0f3a-36de-4680-8ff7-cdf5d093e3ee tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:20.159883 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fcfd0f3a-36de-4680-8ff7-cdf5d093e3ee tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:20.160384 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fcfd0f3a-36de-4680-8ff7-cdf5d093e3ee tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:20.160817 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fcfd0f3a-36de-4680-8ff7-cdf5d093e3ee tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:20.161499 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fcfd0f3a-36de-4680-8ff7-cdf5d093e3ee tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:20.161976 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fcfd0f3a-36de-4680-8ff7-cdf5d093e3ee tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:20.162400 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fcfd0f3a-36de-4680-8ff7-cdf5d093e3ee tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:20.257008 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-fcfd0f3a-36de-4680-8ff7-cdf5d093e3ee tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lazy-loading 'services' on Instance uuid bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:42:20.334484 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-eb49a0c3-b25b-42bd-b218-c101c0b55c6a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:20.335174 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-eb49a0c3-b25b-42bd-b218-c101c0b55c6a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] [instance: bce65669-d807-40a9-95e1-8cb85a0f03c3] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:20.344233 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eb49a0c3-b25b-42bd-b218-c101c0b55c6a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:20.344934 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eb49a0c3-b25b-42bd-b218-c101c0b55c6a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:20.345369 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eb49a0c3-b25b-42bd-b218-c101c0b55c6a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:20.346168 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eb49a0c3-b25b-42bd-b218-c101c0b55c6a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:20.346665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eb49a0c3-b25b-42bd-b218-c101c0b55c6a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:20.347147 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-eb49a0c3-b25b-42bd-b218-c101c0b55c6a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:20.384278 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-eb49a0c3-b25b-42bd-b218-c101c0b55c6a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] HTTP exception thrown: Instance bce65669-d807-40a9-95e1-8cb85a0f03c3 could not be found. Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-eb49a0c3-b25b-42bd-b218-c101c0b55c6a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Request method failure captured: Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 HTTP/1.1 Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDq0PMgTLokwVG09avvQRTf7BWQL6UL5EdRbaTv-ZuWxLniOeugYlmPMcSqrWwSg-OPRJDiop2FwYr2AkFtUe74Xi0V3Q0fGuxyhnUz2lrFx18YAXmgywAkX8c_V_7GRd1uofyfKkPSvacVkhrz45duCHB8E6U6K9_7AWok7sEmDuSk8 Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: 28f0cda364854dfd9fde0249a751ecf4 Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-TestShelveInstance-830157553 Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:42:20.386300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:42:20.387742 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/28f0cda364854dfd9fde0249a751ecf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/28f0cda364854dfd9fde0249a751ecf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/28f0cda364854dfd9fde0249a751ecf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_28f0cda364854dfd9fde0249a751ecf4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:20.387742 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-TestShelveInstance-830157553 Aug 31 00:42:20.387742 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: 28f0cda364854dfd9fde0249a751ecf4 Aug 31 00:42:20.387742 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-TestShelveInstance-830157553 Aug 31 00:42:20.387742 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-TestShelveInstance-830157553-project Aug 31 00:42:20.387742 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:42:20.387742 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:42:20.387742 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: c639977b5f6744b9939d1e5a9745cd03 Aug 31 00:42:20.387742 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-TestShelveInstance-830157553-project Aug 31 00:42:20.387742 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:42:20.387742 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance bce65669-d807-40a9-95e1-8cb85a0f03c3 could not be found. Aug 31 00:42:20.387742 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': 'bce65669-d807-40a9-95e1-8cb85a0f03c3'} Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce65669-d807-40a9-95e1-8cb85a0f03c3 could not be found. Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:20.388560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:20.389744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:20.389744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:42:20.389744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:42:20.389744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:20.389744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:20.389744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:20.389744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:20.389744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce65669-d807-40a9-95e1-8cb85a0f03c3 could not be found. Aug 31 00:42:20.389744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:20.389744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:20.389744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:20.389744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:20.389744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:20.389744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:20.389744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:20.389744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:20.389744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce65669-d807-40a9-95e1-8cb85a0f03c3 could not be found. Aug 31 00:42:20.389744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:20.390895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-eb49a0c3-b25b-42bd-b218-c101c0b55c6a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Returning 404 to user: Instance bce65669-d807-40a9-95e1-8cb85a0f03c3 could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:20.390895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-eb49a0c3-b25b-42bd-b218-c101c0b55c6a tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3" status: 404 len: 111 microversion: 2.1 time: 0.057510 Aug 31 00:42:20.394170 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 471/956] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:20 2022] GET /compute/v2.1/servers/bce65669-d807-40a9-95e1-8cb85a0f03c3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:20.427923 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-304ec3e1-8500-4568-98ca-1581b7103e50 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:20.428676 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-304ec3e1-8500-4568-98ca-1581b7103e50 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:20.443946 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-304ec3e1-8500-4568-98ca-1581b7103e50 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:20.444473 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-304ec3e1-8500-4568-98ca-1581b7103e50 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:20.445285 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-304ec3e1-8500-4568-98ca-1581b7103e50 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:20.446001 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-304ec3e1-8500-4568-98ca-1581b7103e50 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:20.446456 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-304ec3e1-8500-4568-98ca-1581b7103e50 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:20.447430 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-304ec3e1-8500-4568-98ca-1581b7103e50 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:20.511351 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-fcfd0f3a-36de-4680-8ff7-cdf5d093e3ee tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments/ed8d7357-18dc-4f18-b00d-b39e0ef13828" status: 202 len: 0 microversion: 2.1 time: 0.361201 Aug 31 00:42:20.514582 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 486/957] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 00:42:20 2022] DELETE /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments/ed8d7357-18dc-4f18-b00d-b39e0ef13828 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:42:20.780414 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-304ec3e1-8500-4568-98ca-1581b7103e50 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:20.788236 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-304ec3e1-8500-4568-98ca-1581b7103e50 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1278 microversion: 2.1 time: 0.365515 Aug 31 00:42:20.788904 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 472/958] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:20 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1278 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:20.953966 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-402d728f-f75a-4ce1-9e45-6f2dde23ebf1 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] Calling method '.version_select at 0x7f551eabbee0>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:21.064264 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-402d728f-f75a-4ce1-9e45-6f2dde23ebf1 tempest-TestShelveInstance-830157553 tempest-TestShelveInstance-830157553-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-879339634" status: 202 len: 0 microversion: 2.1 time: 0.114449 Aug 31 00:42:21.064868 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 487/959] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 31 00:42:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-879339634 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:42:21.149754 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-20812c0a-9de1-41e1-88ea-0f77eb63d847 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:21.150328 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-20812c0a-9de1-41e1-88ea-0f77eb63d847 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:21.155644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-71f8c9ed-6431-4e12-aaf1-21b226e58ad6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:21.156887 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-71f8c9ed-6431-4e12-aaf1-21b226e58ad6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:21.157620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-20812c0a-9de1-41e1-88ea-0f77eb63d847 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:21.158356 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-20812c0a-9de1-41e1-88ea-0f77eb63d847 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:21.159079 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-20812c0a-9de1-41e1-88ea-0f77eb63d847 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:21.159952 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-20812c0a-9de1-41e1-88ea-0f77eb63d847 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:21.161005 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-20812c0a-9de1-41e1-88ea-0f77eb63d847 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:21.161964 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-20812c0a-9de1-41e1-88ea-0f77eb63d847 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:21.170977 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-71f8c9ed-6431-4e12-aaf1-21b226e58ad6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:21.172887 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-71f8c9ed-6431-4e12-aaf1-21b226e58ad6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:21.173603 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-71f8c9ed-6431-4e12-aaf1-21b226e58ad6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:21.174587 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-71f8c9ed-6431-4e12-aaf1-21b226e58ad6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:21.175742 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-71f8c9ed-6431-4e12-aaf1-21b226e58ad6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:21.176490 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-71f8c9ed-6431-4e12-aaf1-21b226e58ad6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:21.197670 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-20812c0a-9de1-41e1-88ea-0f77eb63d847 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] HTTP exception thrown: Instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d could not be found. Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-20812c0a-9de1-41e1-88ea-0f77eb63d847 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Request method failure captured: Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: DELETE /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d HTTP/1.1 Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDqy7MJOpqb7URH2NMlvnlry7FN8PMqekPyTr4WdpuFP-EJ4P09V7u5pIkcg9D2y64tDq06EhUYjkLoVEA5Xo6OkeLUr7BvIjtmrEoq-poVSUiJYXz83e0U_QXEU4_Gc_m-Y7QkotdhwKhL3RvXqk7a5HcYY_0K_fB-YMAW3D8wMuR_c Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:42:21.202852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:42:21.204453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:21.204453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:21.204453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:42:21.204453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:21.204453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:42:21.204453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:42:21.204453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:42:21.204453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 45422a67a78f4784abc0f18ad84778f3 Aug 31 00:42:21.204453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:42:21.204453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:42:21.204453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d could not be found. Aug 31 00:42:21.204453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': '64ff706f-9d6e-4268-a6db-3b4c37cf514d'} Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d could not be found. Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:21.205355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d could not be found. Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d could not be found. Aug 31 00:42:21.206773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:21.209095 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-20812c0a-9de1-41e1-88ea-0f77eb63d847 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Returning 404 to user: Instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:21.210109 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-20812c0a-9de1-41e1-88ea-0f77eb63d847 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "DELETE /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 404 len: 111 microversion: 2.1 time: 0.064884 Aug 31 00:42:21.211150 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 473/960] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:42:21 2022] DELETE /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:21.221353 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f09059ec-2e51-4dd5-bbfa-a122769eb937 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:21.221964 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-f09059ec-2e51-4dd5-bbfa-a122769eb937 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] [instance: 64ff706f-9d6e-4268-a6db-3b4c37cf514d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:21.229732 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f09059ec-2e51-4dd5-bbfa-a122769eb937 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:21.230220 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f09059ec-2e51-4dd5-bbfa-a122769eb937 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:21.230654 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f09059ec-2e51-4dd5-bbfa-a122769eb937 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:21.231437 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f09059ec-2e51-4dd5-bbfa-a122769eb937 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:21.231885 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f09059ec-2e51-4dd5-bbfa-a122769eb937 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:21.232305 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f09059ec-2e51-4dd5-bbfa-a122769eb937 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:21.246687 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-f09059ec-2e51-4dd5-bbfa-a122769eb937 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] HTTP exception thrown: Instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d could not be found. Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f09059ec-2e51-4dd5-bbfa-a122769eb937 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Request method failure captured: Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d HTTP/1.1 Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDqy7MJOpqb7URH2NMlvnlry7FN8PMqekPyTr4WdpuFP-EJ4P09V7u5pIkcg9D2y64tDq06EhUYjkLoVEA5Xo6OkeLUr7BvIjtmrEoq-poVSUiJYXz83e0U_QXEU4_Gc_m-Y7QkotdhwKhL3RvXqk7a5HcYY_0K_fB-YMAW3D8wMuR_c Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:42:21.248297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:42:21.250839 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec5893d9a55f4ed28f6579397d0d6f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:21.250839 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:21.250839 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: ec5893d9a55f4ed28f6579397d0d6f21 Aug 31 00:42:21.250839 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-266494594 Aug 31 00:42:21.250839 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:42:21.250839 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:42:21.250839 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:42:21.250839 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 45422a67a78f4784abc0f18ad84778f3 Aug 31 00:42:21.250839 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-AttachVolumeNegativeTest-266494594-project Aug 31 00:42:21.250839 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:42:21.250839 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d could not be found. Aug 31 00:42:21.250839 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': '64ff706f-9d6e-4268-a6db-3b4c37cf514d'} Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d could not be found. Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:21.252254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:21.256100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:21.256100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:42:21.256100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:42:21.256100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:21.256100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:21.256100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:21.256100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:21.256100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d could not be found. Aug 31 00:42:21.256100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:21.256100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:21.256100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:21.256100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:21.256100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:21.256100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:21.256100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:21.256100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:21.256100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d could not be found. Aug 31 00:42:21.256100 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:21.258503 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f09059ec-2e51-4dd5-bbfa-a122769eb937 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] Returning 404 to user: Instance 64ff706f-9d6e-4268-a6db-3b4c37cf514d could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:21.258503 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f09059ec-2e51-4dd5-bbfa-a122769eb937 tempest-AttachVolumeNegativeTest-266494594 tempest-AttachVolumeNegativeTest-266494594-project] 10.222.0.65 "GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d" status: 404 len: 111 microversion: 2.1 time: 0.033982 Aug 31 00:42:21.258503 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 474/961] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:21 2022] GET /compute/v2.1/servers/64ff706f-9d6e-4268-a6db-3b4c37cf514d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:42:21.425736 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-71f8c9ed-6431-4e12-aaf1-21b226e58ad6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:21.437932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-71f8c9ed-6431-4e12-aaf1-21b226e58ad6 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1312 microversion: 2.1 time: 0.287261 Aug 31 00:42:21.439913 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 488/962] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:21 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1312 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:21.808931 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-92c92736-d8b8-437f-b9aa-41e7f68d6445 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:21.809701 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-92c92736-d8b8-437f-b9aa-41e7f68d6445 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:21.815988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-e9db99f7-9c5a-41dd-a6a8-1f432e8f5aac req-d8c83978-042f-4ecf-a378-56c3862a3df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bbab6f-dd9e-4d5d-a854-d2eac6817f5c", "name": "network-vif-plugged", "status": "completed", "tag": "85ff1e83-3c0f-44de-b1cd-f61df71f6257"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:42:21.819091 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-92c92736-d8b8-437f-b9aa-41e7f68d6445 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:21.819091 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-92c92736-d8b8-437f-b9aa-41e7f68d6445 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:21.819091 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-92c92736-d8b8-437f-b9aa-41e7f68d6445 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:21.819680 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-92c92736-d8b8-437f-b9aa-41e7f68d6445 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:21.820395 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-92c92736-d8b8-437f-b9aa-41e7f68d6445 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:21.821049 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-92c92736-d8b8-437f-b9aa-41e7f68d6445 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:21.831181 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-e9db99f7-9c5a-41dd-a6a8-1f432e8f5aac req-d8c83978-042f-4ecf-a378-56c3862a3df1 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:21.831863 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-e9db99f7-9c5a-41dd-a6a8-1f432e8f5aac req-d8c83978-042f-4ecf-a378-56c3862a3df1 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:21.832486 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-e9db99f7-9c5a-41dd-a6a8-1f432e8f5aac req-d8c83978-042f-4ecf-a378-56c3862a3df1 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:21.852141 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-e9db99f7-9c5a-41dd-a6a8-1f432e8f5aac req-d8c83978-042f-4ecf-a378-56c3862a3df1 service nova] Creating event network-vif-plugged:85ff1e83-3c0f-44de-b1cd-f61df71f6257 for instance 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c on hv-cinder-85221 Aug 31 00:42:21.858982 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-e9db99f7-9c5a-41dd-a6a8-1f432e8f5aac req-d8c83978-042f-4ecf-a378-56c3862a3df1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047142 Aug 31 00:42:21.860944 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 489/963] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:42:22.036225 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-19d659fb-986f-4631-98bf-a5cb8fe34dd6 req-9153a2b4-7bc7-4a9a-a4a5-01296504c467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "238e7167-528f-4320-99b2-344f8683cde6", "tag": "d6e8579c-bd80-41e5-85c3-d0906fe6933e"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:42:22.058985 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-19d659fb-986f-4631-98bf-a5cb8fe34dd6 req-9153a2b4-7bc7-4a9a-a4a5-01296504c467 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:22.059576 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-19d659fb-986f-4631-98bf-a5cb8fe34dd6 req-9153a2b4-7bc7-4a9a-a4a5-01296504c467 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:22.060190 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-19d659fb-986f-4631-98bf-a5cb8fe34dd6 req-9153a2b4-7bc7-4a9a-a4a5-01296504c467 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:22.084683 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-19d659fb-986f-4631-98bf-a5cb8fe34dd6 req-9153a2b4-7bc7-4a9a-a4a5-01296504c467 service nova] Creating event network-changed:d6e8579c-bd80-41e5-85c3-d0906fe6933e for instance 238e7167-528f-4320-99b2-344f8683cde6 on hv-cinder-85221 Aug 31 00:42:22.092611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-19d659fb-986f-4631-98bf-a5cb8fe34dd6 req-9153a2b4-7bc7-4a9a-a4a5-01296504c467 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059853 Aug 31 00:42:22.093726 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 490/964] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:42:22.187398 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-92c92736-d8b8-437f-b9aa-41e7f68d6445 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:22.195924 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-92c92736-d8b8-437f-b9aa-41e7f68d6445 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1278 microversion: 2.1 time: 0.390963 Aug 31 00:42:22.197288 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 475/965] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:21 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1278 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:22.250526 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-64822e4f-c7e0-470d-a22c-6068871a96bf tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:22.253061 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-64822e4f-c7e0-470d-a22c-6068871a96bf tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:22.273472 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-64822e4f-c7e0-470d-a22c-6068871a96bf tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:22.275946 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-64822e4f-c7e0-470d-a22c-6068871a96bf tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:22.276667 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-64822e4f-c7e0-470d-a22c-6068871a96bf tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:22.277493 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-64822e4f-c7e0-470d-a22c-6068871a96bf tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:22.278086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-64822e4f-c7e0-470d-a22c-6068871a96bf tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:22.278607 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-64822e4f-c7e0-470d-a22c-6068871a96bf tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:22.296924 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-64822e4f-c7e0-470d-a22c-6068871a96bf tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] HTTP exception thrown: Instance 302d7397-56df-414b-a380-afc6b65fc8fa could not be found. Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-64822e4f-c7e0-470d-a22c-6068871a96bf tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Request method failure captured: Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: DELETE /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa HTTP/1.1 Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqy5VUB-5vypeDrL9KyCtyy2DyyS5WzgA3UmCKlzAVIbXiUyGwtNVKH4YdoT43FxVSPzB7q3qaWOdTbrhgpdvz9RHCjhxPCeLGhp5RRsc3mvVYG2xmERbClJhrObqW-PqS5mvLReqxJb9XnQ-nSdy0f8YpzQvsj6A3VB2qOFnuuWu98 Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: 606c24bee18a4454ab672cfb6a395286 Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1045984733 Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:42:22.299013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:42:22.300733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/606c24bee18a4454ab672cfb6a395286"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/606c24bee18a4454ab672cfb6a395286"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/606c24bee18a4454ab672cfb6a395286"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_606c24bee18a4454ab672cfb6a395286"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:22.300733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1045984733 Aug 31 00:42:22.300733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: 606c24bee18a4454ab672cfb6a395286 Aug 31 00:42:22.300733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1045984733 Aug 31 00:42:22.300733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-AttachVolumeShelveTestJSON-1045984733-project Aug 31 00:42:22.300733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:42:22.300733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:42:22.300733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 2a927401086b4a649919a6071b4a0fd9 Aug 31 00:42:22.300733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1045984733-project Aug 31 00:42:22.300733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:42:22.300733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance 302d7397-56df-414b-a380-afc6b65fc8fa could not be found. Aug 31 00:42:22.300733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': '302d7397-56df-414b-a380-afc6b65fc8fa'} Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 302d7397-56df-414b-a380-afc6b65fc8fa could not be found. Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:22.301678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 302d7397-56df-414b-a380-afc6b65fc8fa could not be found. Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 302d7397-56df-414b-a380-afc6b65fc8fa could not be found. Aug 31 00:42:22.302958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:22.304121 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-64822e4f-c7e0-470d-a22c-6068871a96bf tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Returning 404 to user: Instance 302d7397-56df-414b-a380-afc6b65fc8fa could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:22.304121 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-64822e4f-c7e0-470d-a22c-6068871a96bf tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "DELETE /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 404 len: 111 microversion: 2.20 time: 0.063957 Aug 31 00:42:22.304121 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 491/966] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 31 00:42:22 2022] DELETE /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:42:22.314105 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-73c732b4-2353-4fb2-a5b3-e6ce6682faef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:22.315102 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-73c732b4-2353-4fb2-a5b3-e6ce6682faef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: 302d7397-56df-414b-a380-afc6b65fc8fa] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:22.323031 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-73c732b4-2353-4fb2-a5b3-e6ce6682faef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:22.323815 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-73c732b4-2353-4fb2-a5b3-e6ce6682faef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:22.324630 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-73c732b4-2353-4fb2-a5b3-e6ce6682faef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:22.325673 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-73c732b4-2353-4fb2-a5b3-e6ce6682faef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:22.326320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-73c732b4-2353-4fb2-a5b3-e6ce6682faef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:22.327210 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-73c732b4-2353-4fb2-a5b3-e6ce6682faef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:22.347774 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-73c732b4-2353-4fb2-a5b3-e6ce6682faef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] HTTP exception thrown: Instance 302d7397-56df-414b-a380-afc6b65fc8fa could not be found. Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-73c732b4-2353-4fb2-a5b3-e6ce6682faef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Request method failure captured: Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa HTTP/1.1 Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDqy5VUB-5vypeDrL9KyCtyy2DyyS5WzgA3UmCKlzAVIbXiUyGwtNVKH4YdoT43FxVSPzB7q3qaWOdTbrhgpdvz9RHCjhxPCeLGhp5RRsc3mvVYG2xmERbClJhrObqW-PqS5mvLReqxJb9XnQ-nSdy0f8YpzQvsj6A3VB2qOFnuuWu98 Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: 606c24bee18a4454ab672cfb6a395286 Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1045984733 Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:42:22.349665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:42:22.357796 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/606c24bee18a4454ab672cfb6a395286"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/606c24bee18a4454ab672cfb6a395286"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/606c24bee18a4454ab672cfb6a395286"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_606c24bee18a4454ab672cfb6a395286"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:22.357796 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1045984733 Aug 31 00:42:22.357796 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: 606c24bee18a4454ab672cfb6a395286 Aug 31 00:42:22.357796 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1045984733 Aug 31 00:42:22.357796 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-AttachVolumeShelveTestJSON-1045984733-project Aug 31 00:42:22.357796 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:42:22.357796 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:42:22.357796 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 2a927401086b4a649919a6071b4a0fd9 Aug 31 00:42:22.357796 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1045984733-project Aug 31 00:42:22.357796 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:42:22.357796 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance 302d7397-56df-414b-a380-afc6b65fc8fa could not be found. Aug 31 00:42:22.357796 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': '302d7397-56df-414b-a380-afc6b65fc8fa'} Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 302d7397-56df-414b-a380-afc6b65fc8fa could not be found. Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:22.358521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:22.359913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:22.359913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:42:22.359913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:42:22.359913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:22.359913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:22.359913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:22.359913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:22.359913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 302d7397-56df-414b-a380-afc6b65fc8fa could not be found. Aug 31 00:42:22.359913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:22.359913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:22.359913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:22.359913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:22.359913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:22.359913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:22.359913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:22.359913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:22.359913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 302d7397-56df-414b-a380-afc6b65fc8fa could not be found. Aug 31 00:42:22.359913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:22.361280 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-73c732b4-2353-4fb2-a5b3-e6ce6682faef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Returning 404 to user: Instance 302d7397-56df-414b-a380-afc6b65fc8fa could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:22.361280 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-73c732b4-2353-4fb2-a5b3-e6ce6682faef tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa" status: 404 len: 111 microversion: 2.20 time: 0.041762 Aug 31 00:42:22.361280 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 476/967] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:42:22 2022] GET /compute/v2.1/servers/302d7397-56df-414b-a380-afc6b65fc8fa => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:42:22.474664 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-328f8769-0194-4c4a-9be7-340eba30635f tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:22.474664 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-328f8769-0194-4c4a-9be7-340eba30635f tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:22.474664 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-328f8769-0194-4c4a-9be7-340eba30635f tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:22.474664 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-328f8769-0194-4c4a-9be7-340eba30635f tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:22.475158 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-328f8769-0194-4c4a-9be7-340eba30635f tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:22.475158 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-328f8769-0194-4c4a-9be7-340eba30635f tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:22.475158 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-328f8769-0194-4c4a-9be7-340eba30635f tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:22.475158 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-328f8769-0194-4c4a-9be7-340eba30635f tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:22.792512 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-328f8769-0194-4c4a-9be7-340eba30635f tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:22.805061 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-328f8769-0194-4c4a-9be7-340eba30635f tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1312 microversion: 2.1 time: 0.344589 Aug 31 00:42:22.820445 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 492/968] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:22 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1312 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:22.863655 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-05f929e9-1621-45bc-aae1-605b7fd1febd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:22.866167 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-05f929e9-1621-45bc-aae1-605b7fd1febd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:22.880546 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-05f929e9-1621-45bc-aae1-605b7fd1febd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:22.881327 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-05f929e9-1621-45bc-aae1-605b7fd1febd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:22.882752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-05f929e9-1621-45bc-aae1-605b7fd1febd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:22.883710 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-05f929e9-1621-45bc-aae1-605b7fd1febd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:22.886314 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-05f929e9-1621-45bc-aae1-605b7fd1febd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:22.887853 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-05f929e9-1621-45bc-aae1-605b7fd1febd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:22.934349 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-05f929e9-1621-45bc-aae1-605b7fd1febd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074451 Aug 31 00:42:22.934922 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 477/969] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:22 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:42:23.086174 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f36d57bb-84a3-41c0-9255-d19d4781bc19 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:23.090152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f36d57bb-84a3-41c0-9255-d19d4781bc19 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:23.097195 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f36d57bb-84a3-41c0-9255-d19d4781bc19 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:23.097789 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f36d57bb-84a3-41c0-9255-d19d4781bc19 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:23.098295 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f36d57bb-84a3-41c0-9255-d19d4781bc19 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:23.099107 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f36d57bb-84a3-41c0-9255-d19d4781bc19 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:23.099646 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f36d57bb-84a3-41c0-9255-d19d4781bc19 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:23.100885 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f36d57bb-84a3-41c0-9255-d19d4781bc19 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:23.138793 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f36d57bb-84a3-41c0-9255-d19d4781bc19 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057173 Aug 31 00:42:23.144408 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 493/970] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:42:23 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:42:23.214942 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=4 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:23.218294 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-80026203-62e7-4944-898e-cbc55c4825c6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:23.219160 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-80026203-62e7-4944-898e-cbc55c4825c6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:23.220044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-0a2b7052-ef09-451e-beec-93b952cdd525 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:23.221525 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-0a2b7052-ef09-451e-beec-93b952cdd525 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:23.231083 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-80026203-62e7-4944-898e-cbc55c4825c6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:23.231660 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-80026203-62e7-4944-898e-cbc55c4825c6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:23.232065 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0a2b7052-ef09-451e-beec-93b952cdd525 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:23.232192 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-80026203-62e7-4944-898e-cbc55c4825c6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:23.233171 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-80026203-62e7-4944-898e-cbc55c4825c6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:23.233298 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0a2b7052-ef09-451e-beec-93b952cdd525 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:23.233665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0a2b7052-ef09-451e-beec-93b952cdd525 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:23.234454 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0a2b7052-ef09-451e-beec-93b952cdd525 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:23.235132 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0a2b7052-ef09-451e-beec-93b952cdd525 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:23.235650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0a2b7052-ef09-451e-beec-93b952cdd525 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:23.235771 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-80026203-62e7-4944-898e-cbc55c4825c6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:23.236459 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-80026203-62e7-4944-898e-cbc55c4825c6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:23.275350 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-0a2b7052-ef09-451e-beec-93b952cdd525 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Going to try to terminate instance {{(pid=128048) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:42:23.550296 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-80026203-62e7-4944-898e-cbc55c4825c6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:23.569040 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-80026203-62e7-4944-898e-cbc55c4825c6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1266 microversion: 2.1 time: 0.348956 Aug 31 00:42:23.573657 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 494/971] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:23 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1266 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:23.678561 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=14 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:23.707203 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c040236d-6a4c-4f87-a5e2-7eee29adeb6a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:23.707753 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c040236d-6a4c-4f87-a5e2-7eee29adeb6a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:23.721378 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c040236d-6a4c-4f87-a5e2-7eee29adeb6a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:23.721987 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c040236d-6a4c-4f87-a5e2-7eee29adeb6a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:23.722432 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c040236d-6a4c-4f87-a5e2-7eee29adeb6a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:23.723353 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c040236d-6a4c-4f87-a5e2-7eee29adeb6a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:23.724055 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c040236d-6a4c-4f87-a5e2-7eee29adeb6a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:23.725891 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c040236d-6a4c-4f87-a5e2-7eee29adeb6a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:23.745947 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-c040236d-6a4c-4f87-a5e2-7eee29adeb6a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] HTTP exception thrown: Instance dfc3d686-f358-4b8f-b983-984fd54e31e1 could not be found. Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c040236d-6a4c-4f87-a5e2-7eee29adeb6a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Request method failure captured: Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: DELETE /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 HTTP/1.1 Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqy5VUB-5vypeDrL9KyCtyy2DyyS5WzgA3UmCKlzAVIbXiUyGwtNVKH4YdoT43FxVSPzB7q3qaWOdTbrhgpdvz9RHCjhxPCeLGhp5RRsc3mvVYG2xmERbClJhrObqW-PqS5mvLReqxJb9XnQ-nSdy0f8YpzQvsj6A3VB2qOFnuuWu98 Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: 606c24bee18a4454ab672cfb6a395286 Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1045984733 Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:42:23.749108 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:42:23.750784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/606c24bee18a4454ab672cfb6a395286"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/606c24bee18a4454ab672cfb6a395286"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/606c24bee18a4454ab672cfb6a395286"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_606c24bee18a4454ab672cfb6a395286"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:23.750784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1045984733 Aug 31 00:42:23.750784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: 606c24bee18a4454ab672cfb6a395286 Aug 31 00:42:23.750784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1045984733 Aug 31 00:42:23.750784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-AttachVolumeShelveTestJSON-1045984733-project Aug 31 00:42:23.750784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:42:23.750784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:42:23.750784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 2a927401086b4a649919a6071b4a0fd9 Aug 31 00:42:23.750784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1045984733-project Aug 31 00:42:23.750784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:42:23.750784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance dfc3d686-f358-4b8f-b983-984fd54e31e1 could not be found. Aug 31 00:42:23.750784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': 'dfc3d686-f358-4b8f-b983-984fd54e31e1'} Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc3d686-f358-4b8f-b983-984fd54e31e1 could not be found. Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:23.751689 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc3d686-f358-4b8f-b983-984fd54e31e1 could not be found. Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc3d686-f358-4b8f-b983-984fd54e31e1 could not be found. Aug 31 00:42:23.753775 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:23.756672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c040236d-6a4c-4f87-a5e2-7eee29adeb6a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Returning 404 to user: Instance dfc3d686-f358-4b8f-b983-984fd54e31e1 could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:23.757543 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c040236d-6a4c-4f87-a5e2-7eee29adeb6a tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "DELETE /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 404 len: 111 microversion: 2.20 time: 0.057889 Aug 31 00:42:23.758104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 495/972] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 31 00:42:23 2022] DELETE /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 00:42:23.767330 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0cdea490-0820-4360-a9c1-690d7ca32e97 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:23.767939 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-0cdea490-0820-4360-a9c1-690d7ca32e97 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] [instance: dfc3d686-f358-4b8f-b983-984fd54e31e1] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:23.775470 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0cdea490-0820-4360-a9c1-690d7ca32e97 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:23.775670 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0cdea490-0820-4360-a9c1-690d7ca32e97 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:23.776096 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0cdea490-0820-4360-a9c1-690d7ca32e97 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:23.777029 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0cdea490-0820-4360-a9c1-690d7ca32e97 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:23.777669 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0cdea490-0820-4360-a9c1-690d7ca32e97 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:23.777897 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0cdea490-0820-4360-a9c1-690d7ca32e97 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:23.793887 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-0cdea490-0820-4360-a9c1-690d7ca32e97 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] HTTP exception thrown: Instance dfc3d686-f358-4b8f-b983-984fd54e31e1 could not be found. Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0cdea490-0820-4360-a9c1-690d7ca32e97 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Request method failure captured: Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 HTTP/1.1 Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqy5VUB-5vypeDrL9KyCtyy2DyyS5WzgA3UmCKlzAVIbXiUyGwtNVKH4YdoT43FxVSPzB7q3qaWOdTbrhgpdvz9RHCjhxPCeLGhp5RRsc3mvVYG2xmERbClJhrObqW-PqS5mvLReqxJb9XnQ-nSdy0f8YpzQvsj6A3VB2qOFnuuWu98 Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: 606c24bee18a4454ab672cfb6a395286 Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1045984733 Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:42:23.795347 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:42:23.797002 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/606c24bee18a4454ab672cfb6a395286"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/606c24bee18a4454ab672cfb6a395286"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/606c24bee18a4454ab672cfb6a395286"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_606c24bee18a4454ab672cfb6a395286"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:23.797002 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1045984733 Aug 31 00:42:23.797002 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: 606c24bee18a4454ab672cfb6a395286 Aug 31 00:42:23.797002 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1045984733 Aug 31 00:42:23.797002 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-AttachVolumeShelveTestJSON-1045984733-project Aug 31 00:42:23.797002 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:42:23.797002 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:42:23.797002 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 2a927401086b4a649919a6071b4a0fd9 Aug 31 00:42:23.797002 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1045984733-project Aug 31 00:42:23.797002 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:42:23.797002 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance dfc3d686-f358-4b8f-b983-984fd54e31e1 could not be found. Aug 31 00:42:23.797002 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': 'dfc3d686-f358-4b8f-b983-984fd54e31e1'} Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc3d686-f358-4b8f-b983-984fd54e31e1 could not be found. Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:23.797788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:23.798949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:23.798949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:42:23.798949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:42:23.798949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:23.798949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:23.798949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:23.798949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:23.798949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc3d686-f358-4b8f-b983-984fd54e31e1 could not be found. Aug 31 00:42:23.798949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:23.798949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:23.798949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:23.798949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:23.798949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:23.798949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:23.798949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:23.798949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:23.798949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc3d686-f358-4b8f-b983-984fd54e31e1 could not be found. Aug 31 00:42:23.798949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:23.800131 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0cdea490-0820-4360-a9c1-690d7ca32e97 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] Returning 404 to user: Instance dfc3d686-f358-4b8f-b983-984fd54e31e1 could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:23.800131 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-0cdea490-0820-4360-a9c1-690d7ca32e97 tempest-AttachVolumeShelveTestJSON-1045984733 tempest-AttachVolumeShelveTestJSON-1045984733-project] 10.222.0.65 "GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1" status: 404 len: 111 microversion: 2.20 time: 0.033623 Aug 31 00:42:23.801079 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 496/973] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 31 00:42:23 2022] GET /compute/v2.1/servers/dfc3d686-f358-4b8f-b983-984fd54e31e1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 31 00:42:23.843804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6b0d2fac-84ab-42a5-94b4-b500caed6f67 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:23.844990 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6b0d2fac-84ab-42a5-94b4-b500caed6f67 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:23.852096 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6b0d2fac-84ab-42a5-94b4-b500caed6f67 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:23.852779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6b0d2fac-84ab-42a5-94b4-b500caed6f67 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:23.853733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6b0d2fac-84ab-42a5-94b4-b500caed6f67 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:23.855041 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6b0d2fac-84ab-42a5-94b4-b500caed6f67 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:23.855746 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6b0d2fac-84ab-42a5-94b4-b500caed6f67 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:23.856565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6b0d2fac-84ab-42a5-94b4-b500caed6f67 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:23.964230 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-0a2b7052-ef09-451e-beec-93b952cdd525 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 204 len: 0 microversion: 2.1 time: 0.749977 Aug 31 00:42:23.967921 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 478/974] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:42:23 2022] DELETE /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:42:23.974629 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a7c9ed4e-a247-4a98-be9c-8b9c53b5c564 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:23.975632 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-a7c9ed4e-a247-4a98-be9c-8b9c53b5c564 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:23.983544 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a7c9ed4e-a247-4a98-be9c-8b9c53b5c564 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:23.984619 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a7c9ed4e-a247-4a98-be9c-8b9c53b5c564 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:23.985449 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a7c9ed4e-a247-4a98-be9c-8b9c53b5c564 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:23.986418 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a7c9ed4e-a247-4a98-be9c-8b9c53b5c564 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:23.987443 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a7c9ed4e-a247-4a98-be9c-8b9c53b5c564 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:23.988140 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a7c9ed4e-a247-4a98-be9c-8b9c53b5c564 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:24.280258 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-a7c9ed4e-a247-4a98-be9c-8b9c53b5c564 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:24.294056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a7c9ed4e-a247-4a98-be9c-8b9c53b5c564 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1673 microversion: 2.1 time: 0.323888 Aug 31 00:42:24.297781 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 479/975] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:23 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1673 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:24.488645 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6b0d2fac-84ab-42a5-94b4-b500caed6f67 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:24.499112 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6b0d2fac-84ab-42a5-94b4-b500caed6f67 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1312 microversion: 2.1 time: 0.661645 Aug 31 00:42:24.503709 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 497/976] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:23 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1312 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:24.594087 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-610489d7-11ca-4deb-bcf3-9b453c72ccb6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:24.595453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-610489d7-11ca-4deb-bcf3-9b453c72ccb6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:24.610001 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-610489d7-11ca-4deb-bcf3-9b453c72ccb6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:24.610631 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-610489d7-11ca-4deb-bcf3-9b453c72ccb6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:24.612045 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-610489d7-11ca-4deb-bcf3-9b453c72ccb6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:24.613099 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-610489d7-11ca-4deb-bcf3-9b453c72ccb6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:24.615230 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-610489d7-11ca-4deb-bcf3-9b453c72ccb6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:24.617166 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-610489d7-11ca-4deb-bcf3-9b453c72ccb6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:24.941883 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-610489d7-11ca-4deb-bcf3-9b453c72ccb6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:24.950847 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-610489d7-11ca-4deb-bcf3-9b453c72ccb6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1266 microversion: 2.1 time: 0.361846 Aug 31 00:42:24.951735 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 480/977] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:24 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1266 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:25.315169 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-fbe83cb4-da14-4744-a2cb-c8754744bdf9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:25.316016 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-fbe83cb4-da14-4744-a2cb-c8754744bdf9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:25.323657 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fbe83cb4-da14-4744-a2cb-c8754744bdf9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:25.324725 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fbe83cb4-da14-4744-a2cb-c8754744bdf9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:25.329050 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fbe83cb4-da14-4744-a2cb-c8754744bdf9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:25.332708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fbe83cb4-da14-4744-a2cb-c8754744bdf9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:25.332708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fbe83cb4-da14-4744-a2cb-c8754744bdf9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:25.332708 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fbe83cb4-da14-4744-a2cb-c8754744bdf9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:25.522711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9f451aad-f488-43c6-ab0c-fe99e446d7d2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:25.523321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9f451aad-f488-43c6-ab0c-fe99e446d7d2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:25.530187 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f451aad-f488-43c6-ab0c-fe99e446d7d2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:25.530673 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f451aad-f488-43c6-ab0c-fe99e446d7d2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:25.531115 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f451aad-f488-43c6-ab0c-fe99e446d7d2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:25.531815 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f451aad-f488-43c6-ab0c-fe99e446d7d2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:25.532272 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f451aad-f488-43c6-ab0c-fe99e446d7d2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:25.532728 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f451aad-f488-43c6-ab0c-fe99e446d7d2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:25.593236 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-fbe83cb4-da14-4744-a2cb-c8754744bdf9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:25.602573 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-fbe83cb4-da14-4744-a2cb-c8754744bdf9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1673 microversion: 2.1 time: 0.291165 Aug 31 00:42:25.604002 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 498/978] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:25 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1673 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:25.891636 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-9f451aad-f488-43c6-ab0c-fe99e446d7d2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:25.910608 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9f451aad-f488-43c6-ab0c-fe99e446d7d2 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1496 microversion: 2.1 time: 0.383813 Aug 31 00:42:25.912221 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 481/979] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:25 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1496 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:25.976427 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4519b51c-2102-4969-9f1f-42a93a460dea tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:25.977402 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4519b51c-2102-4969-9f1f-42a93a460dea tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:25.984138 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4519b51c-2102-4969-9f1f-42a93a460dea tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:25.984725 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4519b51c-2102-4969-9f1f-42a93a460dea tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:25.985322 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4519b51c-2102-4969-9f1f-42a93a460dea tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:25.986191 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4519b51c-2102-4969-9f1f-42a93a460dea tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:25.990663 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4519b51c-2102-4969-9f1f-42a93a460dea tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:25.991460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4519b51c-2102-4969-9f1f-42a93a460dea tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:26.424732 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4519b51c-2102-4969-9f1f-42a93a460dea tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:26.445291 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4519b51c-2102-4969-9f1f-42a93a460dea tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1266 microversion: 2.1 time: 0.471126 Aug 31 00:42:26.449423 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 499/980] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:25 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1266 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:26.628713 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f1e126a6-1c9d-48fa-98d5-d1de4411ed6e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:26.630094 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-f1e126a6-1c9d-48fa-98d5-d1de4411ed6e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:26.639313 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f1e126a6-1c9d-48fa-98d5-d1de4411ed6e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:26.640095 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f1e126a6-1c9d-48fa-98d5-d1de4411ed6e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:26.641789 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f1e126a6-1c9d-48fa-98d5-d1de4411ed6e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:26.643014 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f1e126a6-1c9d-48fa-98d5-d1de4411ed6e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:26.644199 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f1e126a6-1c9d-48fa-98d5-d1de4411ed6e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:26.644883 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f1e126a6-1c9d-48fa-98d5-d1de4411ed6e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:27.023566 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-eb27f23b-f563-4e24-b70e-0096347c7e2b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:27.025877 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-eb27f23b-f563-4e24-b70e-0096347c7e2b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:27.036829 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-eb27f23b-f563-4e24-b70e-0096347c7e2b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:27.036829 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-eb27f23b-f563-4e24-b70e-0096347c7e2b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:27.036829 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-eb27f23b-f563-4e24-b70e-0096347c7e2b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:27.036829 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-eb27f23b-f563-4e24-b70e-0096347c7e2b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:27.037314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-eb27f23b-f563-4e24-b70e-0096347c7e2b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:27.037314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-eb27f23b-f563-4e24-b70e-0096347c7e2b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:27.070334 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-eb27f23b-f563-4e24-b70e-0096347c7e2b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Going to try to terminate instance {{(pid=128049) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:42:27.088295 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:27.425973 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f1e126a6-1c9d-48fa-98d5-d1de4411ed6e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:27.449723 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-eb27f23b-f563-4e24-b70e-0096347c7e2b tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "DELETE /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 204 len: 0 microversion: 2.1 time: 0.423450 Aug 31 00:42:27.451545 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 500/981] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:42:27 2022] DELETE /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:42:27.460891 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f1e126a6-1c9d-48fa-98d5-d1de4411ed6e tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1673 microversion: 2.1 time: 0.832701 Aug 31 00:42:27.461889 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 482/982] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:26 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1673 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:27.467572 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-2bd0be94-02e3-43a5-bf90-3a8174fd09d3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:27.470988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-2bd0be94-02e3-43a5-bf90-3a8174fd09d3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:27.473738 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-468eeea4-0356-437f-9505-a8e562923b7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:27.474356 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-468eeea4-0356-437f-9505-a8e562923b7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:27.486398 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2bd0be94-02e3-43a5-bf90-3a8174fd09d3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:27.486847 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2bd0be94-02e3-43a5-bf90-3a8174fd09d3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:27.487277 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2bd0be94-02e3-43a5-bf90-3a8174fd09d3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:27.488547 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-468eeea4-0356-437f-9505-a8e562923b7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:27.489260 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-468eeea4-0356-437f-9505-a8e562923b7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:27.490624 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2bd0be94-02e3-43a5-bf90-3a8174fd09d3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:27.491811 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-468eeea4-0356-437f-9505-a8e562923b7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:27.493206 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2bd0be94-02e3-43a5-bf90-3a8174fd09d3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:27.494788 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2bd0be94-02e3-43a5-bf90-3a8174fd09d3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:27.497746 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-468eeea4-0356-437f-9505-a8e562923b7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:27.497746 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-468eeea4-0356-437f-9505-a8e562923b7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:27.498421 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-468eeea4-0356-437f-9505-a8e562923b7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:27.981244 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-468eeea4-0356-437f-9505-a8e562923b7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:28.001129 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-468eeea4-0356-437f-9505-a8e562923b7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1266 microversion: 2.1 time: 0.535764 Aug 31 00:42:28.001716 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 483/983] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:27 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1266 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:28.104459 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-2bd0be94-02e3-43a5-bf90-3a8174fd09d3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:28.118727 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-2bd0be94-02e3-43a5-bf90-3a8174fd09d3 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1502 microversion: 2.1 time: 0.662225 Aug 31 00:42:28.119581 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 501/984] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:27 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1502 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:28.489471 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-09686eb5-107a-4121-8167-543e4fca6e41 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:28.490105 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-09686eb5-107a-4121-8167-543e4fca6e41 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:28.507658 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-09686eb5-107a-4121-8167-543e4fca6e41 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:28.507658 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-09686eb5-107a-4121-8167-543e4fca6e41 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:28.507658 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-09686eb5-107a-4121-8167-543e4fca6e41 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:28.507658 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-09686eb5-107a-4121-8167-543e4fca6e41 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:28.508050 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-09686eb5-107a-4121-8167-543e4fca6e41 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:28.508050 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-09686eb5-107a-4121-8167-543e4fca6e41 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:28.613518 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-09686eb5-107a-4121-8167-543e4fca6e41 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:28.626256 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-09686eb5-107a-4121-8167-543e4fca6e41 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1605 microversion: 2.1 time: 0.142892 Aug 31 00:42:28.629572 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 484/985] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:28 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1605 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:28.954093 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-642b14ec-c31e-4214-bf28-b1fa3f9eb8ed req-aeaf0a4c-bda3-41db-8159-55cdb47d26af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf8cd0c7-4af8-443b-9f8d-d878cc6137e7", "name": "network-vif-deleted", "tag": "a5078607-db3e-4a97-b7ea-6ced696b1877"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:42:28.982281 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-642b14ec-c31e-4214-bf28-b1fa3f9eb8ed req-aeaf0a4c-bda3-41db-8159-55cdb47d26af service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:28.984297 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-642b14ec-c31e-4214-bf28-b1fa3f9eb8ed req-aeaf0a4c-bda3-41db-8159-55cdb47d26af service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:28.984986 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-642b14ec-c31e-4214-bf28-b1fa3f9eb8ed req-aeaf0a4c-bda3-41db-8159-55cdb47d26af service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:29.021315 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-642b14ec-c31e-4214-bf28-b1fa3f9eb8ed req-aeaf0a4c-bda3-41db-8159-55cdb47d26af service nova] Creating event network-vif-deleted:a5078607-db3e-4a97-b7ea-6ced696b1877 for instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 on hv-cinder-85221 Aug 31 00:42:29.023603 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d29b1751-410e-4e01-8e56-b1299274f4af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:29.026489 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d29b1751-410e-4e01-8e56-b1299274f4af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:29.030899 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-642b14ec-c31e-4214-bf28-b1fa3f9eb8ed req-aeaf0a4c-bda3-41db-8159-55cdb47d26af service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086012 Aug 31 00:42:29.035301 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 502/986] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:29.050130 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d29b1751-410e-4e01-8e56-b1299274f4af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:29.051971 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d29b1751-410e-4e01-8e56-b1299274f4af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:29.052393 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d29b1751-410e-4e01-8e56-b1299274f4af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:29.053145 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d29b1751-410e-4e01-8e56-b1299274f4af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:29.080656 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d29b1751-410e-4e01-8e56-b1299274f4af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:29.084651 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d29b1751-410e-4e01-8e56-b1299274f4af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:29.147060 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f5e484ba-b1a6-41d0-9c54-c214c3f1a23e tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:29.148580 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f5e484ba-b1a6-41d0-9c54-c214c3f1a23e tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:29.177241 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f5e484ba-b1a6-41d0-9c54-c214c3f1a23e tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:29.180731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f5e484ba-b1a6-41d0-9c54-c214c3f1a23e tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:29.183543 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f5e484ba-b1a6-41d0-9c54-c214c3f1a23e tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:29.187389 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f5e484ba-b1a6-41d0-9c54-c214c3f1a23e tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:29.192197 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f5e484ba-b1a6-41d0-9c54-c214c3f1a23e tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:29.194373 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f5e484ba-b1a6-41d0-9c54-c214c3f1a23e tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:29.607419 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d29b1751-410e-4e01-8e56-b1299274f4af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:29.616397 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d29b1751-410e-4e01-8e56-b1299274f4af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1266 microversion: 2.1 time: 0.597658 Aug 31 00:42:29.616985 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 485/987] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:29 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1266 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:29.652999 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d028777b-ac89-4f37-b623-4a718c1fac07 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:29.653428 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d028777b-ac89-4f37-b623-4a718c1fac07 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:29.661946 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d028777b-ac89-4f37-b623-4a718c1fac07 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:29.662943 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d028777b-ac89-4f37-b623-4a718c1fac07 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:29.663932 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d028777b-ac89-4f37-b623-4a718c1fac07 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:29.664927 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d028777b-ac89-4f37-b623-4a718c1fac07 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:29.666944 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d028777b-ac89-4f37-b623-4a718c1fac07 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:29.667531 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d028777b-ac89-4f37-b623-4a718c1fac07 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:29.711029 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d028777b-ac89-4f37-b623-4a718c1fac07 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:29.711574 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d028777b-ac89-4f37-b623-4a718c1fac07 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:29.712101 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d028777b-ac89-4f37-b623-4a718c1fac07 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:29.712643 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-d028777b-ac89-4f37-b623-4a718c1fac07 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lazy-loading 'fault' on Instance uuid bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:42:29.772489 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f5e484ba-b1a6-41d0-9c54-c214c3f1a23e tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:29.790550 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d028777b-ac89-4f37-b623-4a718c1fac07 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2476465c4c4bd2b1cf81934b6e9a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5023455241594360bacff911a6641d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:29.795380 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f5e484ba-b1a6-41d0-9c54-c214c3f1a23e tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1502 microversion: 2.1 time: 0.645115 Aug 31 00:42:29.804064 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 503/988] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:29 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1502 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:29.823836 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d028777b-ac89-4f37-b623-4a718c1fac07 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 200 len: 1327 microversion: 2.1 time: 0.173089 Aug 31 00:42:29.825225 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 486/989] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:29 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 1327 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:30.639368 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-42b0bb84-f7a7-4611-9d9b-945ed92f68af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:30.640652 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-42b0bb84-f7a7-4611-9d9b-945ed92f68af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:30.648263 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-42b0bb84-f7a7-4611-9d9b-945ed92f68af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:30.649022 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-42b0bb84-f7a7-4611-9d9b-945ed92f68af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:30.650183 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-42b0bb84-f7a7-4611-9d9b-945ed92f68af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:30.652058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-42b0bb84-f7a7-4611-9d9b-945ed92f68af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:30.652796 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-42b0bb84-f7a7-4611-9d9b-945ed92f68af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:30.653407 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-42b0bb84-f7a7-4611-9d9b-945ed92f68af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:30.831965 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-fac9799f-acd4-4c6c-a0f6-979f20f8014c tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:30.831965 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-fac9799f-acd4-4c6c-a0f6-979f20f8014c tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:30.844304 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fac9799f-acd4-4c6c-a0f6-979f20f8014c tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:30.844821 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fac9799f-acd4-4c6c-a0f6-979f20f8014c tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:30.845251 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fac9799f-acd4-4c6c-a0f6-979f20f8014c tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:30.846153 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fac9799f-acd4-4c6c-a0f6-979f20f8014c tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:30.850426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fac9799f-acd4-4c6c-a0f6-979f20f8014c tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:30.850879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fac9799f-acd4-4c6c-a0f6-979f20f8014c tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:30.865145 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:31.111810 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-42b0bb84-f7a7-4611-9d9b-945ed92f68af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:31.129173 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-42b0bb84-f7a7-4611-9d9b-945ed92f68af tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1266 microversion: 2.1 time: 0.492101 Aug 31 00:42:31.143598 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 504/990] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:30 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1266 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:31.143598 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-1039fd2e-ea0c-4580-9be9-05f6f99f287b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:31.143598 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-1039fd2e-ea0c-4580-9be9-05f6f99f287b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:31.145872 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1039fd2e-ea0c-4580-9be9-05f6f99f287b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:31.146498 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1039fd2e-ea0c-4580-9be9-05f6f99f287b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:31.147071 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1039fd2e-ea0c-4580-9be9-05f6f99f287b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:31.147912 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1039fd2e-ea0c-4580-9be9-05f6f99f287b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:31.148590 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1039fd2e-ea0c-4580-9be9-05f6f99f287b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:31.149367 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1039fd2e-ea0c-4580-9be9-05f6f99f287b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:31.188552 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-1039fd2e-ea0c-4580-9be9-05f6f99f287b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] HTTP exception thrown: Instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 could not be found. Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-1039fd2e-ea0c-4580-9be9-05f6f99f287b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Request method failure captured: Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 HTTP/1.1 Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDq0WcVgXUj-iqbCzauuWxIXx3hi4_qofZE82BYx5XOikwDxchIHG520fBqtCYl8cHU47fOUFJjBDdp5W2EMi347kZ7PFY4_KwJsO5Cgqpj9kW91f6fX6N-8ZpONm6hXbuBuk3igNnJOQyNIEN49-Y7ZRbQSAmkqn5wWcGZtLr093DRU Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: 5023455241594360bacff911a6641d7a Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-AttachVolumeTestJSON-793970641 Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:42:31.190460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:42:31.192072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5023455241594360bacff911a6641d7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5023455241594360bacff911a6641d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5023455241594360bacff911a6641d7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5023455241594360bacff911a6641d7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:31.192072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-AttachVolumeTestJSON-793970641 Aug 31 00:42:31.192072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: 5023455241594360bacff911a6641d7a Aug 31 00:42:31.192072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-AttachVolumeTestJSON-793970641 Aug 31 00:42:31.192072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-AttachVolumeTestJSON-793970641-project Aug 31 00:42:31.192072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:42:31.192072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:42:31.192072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: ac2476465c4c4bd2b1cf81934b6e9a7d Aug 31 00:42:31.192072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-AttachVolumeTestJSON-793970641-project Aug 31 00:42:31.192072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:42:31.192072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 could not be found. Aug 31 00:42:31.192072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': 'bf8cd0c7-4af8-443b-9f8d-d878cc6137e7'} Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 could not be found. Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:31.193156 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:31.194606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:31.194606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:42:31.194606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:42:31.194606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:31.194606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:31.194606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:31.194606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:31.194606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 could not be found. Aug 31 00:42:31.194606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:31.194606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:31.194606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:31.194606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:31.194606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:31.194606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:31.194606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:31.194606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:31.194606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 could not be found. Aug 31 00:42:31.194606 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:31.196109 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-1039fd2e-ea0c-4580-9be9-05f6f99f287b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Returning 404 to user: Instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:31.197232 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-1039fd2e-ea0c-4580-9be9-05f6f99f287b tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 404 len: 111 microversion: 2.1 time: 0.065360 Aug 31 00:42:31.201564 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 505/991] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:31 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:31.209146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6b104fa5-354c-4fb2-9b25-a4218c10e8dd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '.version_select at 0x7f551eb55040>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:31.338176 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6b104fa5-354c-4fb2-9b25-a4218c10e8dd tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-916822675" status: 202 len: 0 microversion: 2.1 time: 0.134695 Aug 31 00:42:31.338770 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 506/992] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Aug 31 00:42:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-916822675 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:42:31.348767 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-7cd814c3-c09b-42b8-9554-8fc8b5f5594b req-12773ec1-0943-4f18-8400-0f039d32452d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bbab6f-dd9e-4d5d-a854-d2eac6817f5c", "name": "network-vif-deleted", "tag": "85ff1e83-3c0f-44de-b1cd-f61df71f6257"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:42:31.382537 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-7cd814c3-c09b-42b8-9554-8fc8b5f5594b req-12773ec1-0943-4f18-8400-0f039d32452d service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:31.383599 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-7cd814c3-c09b-42b8-9554-8fc8b5f5594b req-12773ec1-0943-4f18-8400-0f039d32452d service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:31.383599 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-7cd814c3-c09b-42b8-9554-8fc8b5f5594b req-12773ec1-0943-4f18-8400-0f039d32452d service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:31.404941 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fac9799f-acd4-4c6c-a0f6-979f20f8014c tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdee3106dfb469c9b933ae6fa95569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f17ea07f4eb4e1e9f875cdb6801b69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:31.412783 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-7cd814c3-c09b-42b8-9554-8fc8b5f5594b req-12773ec1-0943-4f18-8400-0f039d32452d service nova] Creating event network-vif-deleted:85ff1e83-3c0f-44de-b1cd-f61df71f6257 for instance 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c on hv-cinder-85221 Aug 31 00:42:31.432768 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-7cd814c3-c09b-42b8-9554-8fc8b5f5594b req-12773ec1-0943-4f18-8400-0f039d32452d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081440 Aug 31 00:42:31.432960 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-fac9799f-acd4-4c6c-a0f6-979f20f8014c tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 200 len: 1460 microversion: 2.1 time: 0.607654 Aug 31 00:42:31.433069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 507/993] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:31.434721 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 487/994] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:30 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 1460 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:32.156680 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-89f51c05-5798-4510-b5a4-93dd12aebc25 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:32.161702 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-89f51c05-5798-4510-b5a4-93dd12aebc25 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:32.162714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:32.183078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-89f51c05-5798-4510-b5a4-93dd12aebc25 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:32.183517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-89f51c05-5798-4510-b5a4-93dd12aebc25 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:32.184041 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-89f51c05-5798-4510-b5a4-93dd12aebc25 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:32.190720 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-89f51c05-5798-4510-b5a4-93dd12aebc25 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:32.191272 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-89f51c05-5798-4510-b5a4-93dd12aebc25 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:32.191712 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-89f51c05-5798-4510-b5a4-93dd12aebc25 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:32.484974 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-89f51c05-5798-4510-b5a4-93dd12aebc25 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:32.485091 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c2871e59-e3e6-4cef-a189-eccfae028584 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:32.485091 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c2871e59-e3e6-4cef-a189-eccfae028584 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] [instance: 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:32.485691 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-89f51c05-5798-4510-b5a4-93dd12aebc25 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1266 microversion: 2.1 time: 0.318049 Aug 31 00:42:32.485691 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 508/995] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:32 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:32.485873 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2871e59-e3e6-4cef-a189-eccfae028584 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:32.487767 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2871e59-e3e6-4cef-a189-eccfae028584 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:32.491588 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2871e59-e3e6-4cef-a189-eccfae028584 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:32.492407 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2871e59-e3e6-4cef-a189-eccfae028584 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:32.492895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2871e59-e3e6-4cef-a189-eccfae028584 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:32.493907 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2871e59-e3e6-4cef-a189-eccfae028584 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:32.533132 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-c2871e59-e3e6-4cef-a189-eccfae028584 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] HTTP exception thrown: Instance 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c could not be found. Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c2871e59-e3e6-4cef-a189-eccfae028584 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Request method failure captured: Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c HTTP/1.1 Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDq5E2Ccv7AWGXMBbz-PqWOgrG1H-_4TxwzKv2GH9Pr15hONcy3wXCvr-9fyCPbcZ2AifFdn-i0iUUuVSCU-h-v8wx_reULXOX_5CfBNCAs_x0KON577lbcQafu0xcmw4mF8TyG2Azr_oZHkeqQGIFNywAA5cs-OhBXlWFF24oGB1g3E Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: 4f17ea07f4eb4e1e9f875cdb6801b69c Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-VolumesActionsTest-1800523304 Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:42:32.534895 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:42:32.539987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f17ea07f4eb4e1e9f875cdb6801b69c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4f17ea07f4eb4e1e9f875cdb6801b69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f17ea07f4eb4e1e9f875cdb6801b69c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4f17ea07f4eb4e1e9f875cdb6801b69c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:32.539987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-VolumesActionsTest-1800523304 Aug 31 00:42:32.539987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: 4f17ea07f4eb4e1e9f875cdb6801b69c Aug 31 00:42:32.539987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-VolumesActionsTest-1800523304 Aug 31 00:42:32.539987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-VolumesActionsTest-1800523304-project Aug 31 00:42:32.539987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:42:32.539987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:42:32.539987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 4cdee3106dfb469c9b933ae6fa95569c Aug 31 00:42:32.539987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-VolumesActionsTest-1800523304-project Aug 31 00:42:32.539987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:42:32.539987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c could not be found. Aug 31 00:42:32.539987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': '42bbab6f-dd9e-4d5d-a854-d2eac6817f5c'} Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c could not be found. Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:32.541620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:32.542955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:32.542955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:42:32.542955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:42:32.542955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:32.542955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:32.542955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:32.542955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:32.542955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c could not be found. Aug 31 00:42:32.542955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:32.542955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:32.542955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:32.542955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:32.542955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:32.542955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:32.542955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:32.542955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:32.542955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c could not be found. Aug 31 00:42:32.542955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:32.544186 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c2871e59-e3e6-4cef-a189-eccfae028584 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] Returning 404 to user: Instance 42bbab6f-dd9e-4d5d-a854-d2eac6817f5c could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:32.544186 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-c2871e59-e3e6-4cef-a189-eccfae028584 tempest-VolumesActionsTest-1800523304 tempest-VolumesActionsTest-1800523304-project] 10.222.0.65 "GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c" status: 404 len: 111 microversion: 2.1 time: 0.085027 Aug 31 00:42:32.544186 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 488/996] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:32 2022] GET /compute/v2.1/servers/42bbab6f-dd9e-4d5d-a854-d2eac6817f5c => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:33.493642 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-35796bb3-b328-4638-b4cc-3eb5b723d46a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:33.499103 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-35796bb3-b328-4638-b4cc-3eb5b723d46a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:33.508138 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-35796bb3-b328-4638-b4cc-3eb5b723d46a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:33.510129 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-35796bb3-b328-4638-b4cc-3eb5b723d46a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:33.511222 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-35796bb3-b328-4638-b4cc-3eb5b723d46a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:33.513029 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-35796bb3-b328-4638-b4cc-3eb5b723d46a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:33.516222 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-35796bb3-b328-4638-b4cc-3eb5b723d46a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:33.517152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-35796bb3-b328-4638-b4cc-3eb5b723d46a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:33.712700 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-35796bb3-b328-4638-b4cc-3eb5b723d46a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:33.722614 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-35796bb3-b328-4638-b4cc-3eb5b723d46a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1266 microversion: 2.1 time: 0.234895 Aug 31 00:42:33.740150 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 509/997] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:33 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:33.867071 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-1a29793f-d5e3-44ba-b536-559c9267519a tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Action: 'create', calling method: .version_select at 0x7f552231f430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-419625891"}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:42:34.722370 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-1a29793f-d5e3-44ba-b536-559c9267519a tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.994951 Aug 31 00:42:34.723292 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 489/998] 10.222.0.65 () {60 vars in 1155 bytes} [Wed Aug 31 00:42:33 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 997 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 31 00:42:34.736753 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-29f1f3e0-0454-46f1-8834-e8354a9008f4 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f551e9d0f70>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:34.745733 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-6f99b851-0639-4e7a-9205-1621015b97a0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:34.746352 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-6f99b851-0639-4e7a-9205-1621015b97a0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:34.753585 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6f99b851-0639-4e7a-9205-1621015b97a0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:34.754073 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6f99b851-0639-4e7a-9205-1621015b97a0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:34.754506 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6f99b851-0639-4e7a-9205-1621015b97a0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:34.755281 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6f99b851-0639-4e7a-9205-1621015b97a0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:34.755736 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6f99b851-0639-4e7a-9205-1621015b97a0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:34.756160 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6f99b851-0639-4e7a-9205-1621015b97a0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:34.800476 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-29f1f3e0-0454-46f1-8834-e8354a9008f4 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e" status: 200 len: 344 microversion: 2.1 time: 0.067475 Aug 31 00:42:34.801051 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 510/999] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 00:42:34 2022] GET /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:34.929583 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-6f99b851-0639-4e7a-9205-1621015b97a0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:34.938448 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-6f99b851-0639-4e7a-9205-1621015b97a0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1266 microversion: 2.1 time: 0.197742 Aug 31 00:42:34.939074 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 490/1000] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:34 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:35.815600 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-48087747-2fe2-4064-a4a0-275e22e95e4b tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f551eacca60>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:35.876846 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-48087747-2fe2-4064-a4a0-275e22e95e4b tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e" status: 200 len: 344 microversion: 2.1 time: 0.065495 Aug 31 00:42:35.877549 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 511/1001] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 00:42:35 2022] GET /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:35.963889 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-4e8f40ed-b798-4832-a3a0-270eba3b24e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:35.967452 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-4e8f40ed-b798-4832-a3a0-270eba3b24e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:35.979398 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4e8f40ed-b798-4832-a3a0-270eba3b24e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:35.982683 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4e8f40ed-b798-4832-a3a0-270eba3b24e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:35.982683 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4e8f40ed-b798-4832-a3a0-270eba3b24e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:35.982683 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4e8f40ed-b798-4832-a3a0-270eba3b24e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:35.982683 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4e8f40ed-b798-4832-a3a0-270eba3b24e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:35.983510 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4e8f40ed-b798-4832-a3a0-270eba3b24e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:36.131875 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4e8f40ed-b798-4832-a3a0-270eba3b24e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:36.140904 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-4e8f40ed-b798-4832-a3a0-270eba3b24e4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1266 microversion: 2.1 time: 0.185128 Aug 31 00:42:36.141556 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 491/1002] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:35 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:36.892280 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-9ffef67f-2775-47be-8e0c-78701d4d2074 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f551eadd700>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:36.944944 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-9ffef67f-2775-47be-8e0c-78701d4d2074 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e" status: 200 len: 344 microversion: 2.1 time: 0.057267 Aug 31 00:42:36.945512 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 512/1003] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 00:42:36 2022] GET /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:37.162490 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-828eef98-eb94-40d5-bb62-3f814d0c4aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:37.163064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-828eef98-eb94-40d5-bb62-3f814d0c4aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:37.165347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:37.170276 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-828eef98-eb94-40d5-bb62-3f814d0c4aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:37.176386 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-828eef98-eb94-40d5-bb62-3f814d0c4aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:37.176386 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-828eef98-eb94-40d5-bb62-3f814d0c4aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:37.176386 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-828eef98-eb94-40d5-bb62-3f814d0c4aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:37.176386 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-828eef98-eb94-40d5-bb62-3f814d0c4aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:37.176800 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-828eef98-eb94-40d5-bb62-3f814d0c4aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:37.305783 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-828eef98-eb94-40d5-bb62-3f814d0c4aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:37.314810 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-828eef98-eb94-40d5-bb62-3f814d0c4aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1266 microversion: 2.1 time: 0.156259 Aug 31 00:42:37.315381 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 492/1004] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:37 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:37.959789 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6cfb8fc6-47c5-4e2f-8456-8a7e4306013e tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f551e9f8940>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:38.011205 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6cfb8fc6-47c5-4e2f-8456-8a7e4306013e tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e" status: 200 len: 344 microversion: 2.1 time: 0.055972 Aug 31 00:42:38.011778 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 513/1005] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 00:42:37 2022] GET /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:38.337101 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c23dfd20-ef63-4efc-98c5-97084896dc7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:38.337724 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c23dfd20-ef63-4efc-98c5-97084896dc7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:38.344292 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c23dfd20-ef63-4efc-98c5-97084896dc7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:38.344818 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c23dfd20-ef63-4efc-98c5-97084896dc7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:38.345252 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c23dfd20-ef63-4efc-98c5-97084896dc7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:38.345957 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c23dfd20-ef63-4efc-98c5-97084896dc7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:38.346408 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c23dfd20-ef63-4efc-98c5-97084896dc7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:38.346834 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c23dfd20-ef63-4efc-98c5-97084896dc7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:38.520277 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c23dfd20-ef63-4efc-98c5-97084896dc7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:38.528954 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-c23dfd20-ef63-4efc-98c5-97084896dc7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1266 microversion: 2.1 time: 0.195626 Aug 31 00:42:38.529538 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 493/1006] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:38 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:39.027406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-25d5a0ba-9027-4837-b5c8-3f03fb90de37 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f551e9bed30>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:39.098140 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-25d5a0ba-9027-4837-b5c8-3f03fb90de37 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e" status: 200 len: 345 microversion: 2.1 time: 0.076181 Aug 31 00:42:39.098717 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 514/1007] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 00:42:39 2022] GET /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e => generated 345 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:39.111465 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-404bdc9d-b127-4719-9504-ec2cbed59e1b tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Action: 'create', calling method: .version_select at 0x7f55222c8d30>, body: {"snapshot": {"volume_id": "d48f39f4-3c5a-4239-bb8c-612f6685d96e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2141818439"}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:42:39.161005 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-db8f30d7-db78-43b1-9572-0eb3676509a9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:39.161494 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-db8f30d7-db78-43b1-9572-0eb3676509a9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:39.174252 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-db8f30d7-db78-43b1-9572-0eb3676509a9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:39.174747 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-db8f30d7-db78-43b1-9572-0eb3676509a9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:39.175269 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-db8f30d7-db78-43b1-9572-0eb3676509a9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:39.175901 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-db8f30d7-db78-43b1-9572-0eb3676509a9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:39.176378 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-db8f30d7-db78-43b1-9572-0eb3676509a9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:39.176805 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-db8f30d7-db78-43b1-9572-0eb3676509a9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:39.192360 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-db8f30d7-db78-43b1-9572-0eb3676509a9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] HTTP exception thrown: Instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 could not be found. Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-db8f30d7-db78-43b1-9572-0eb3676509a9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Request method failure captured: Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: DELETE /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 HTTP/1.1 Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDq0WcVgXUj-iqbCzauuWxIXx3hi4_qofZE82BYx5XOikwDxchIHG520fBqtCYl8cHU47fOUFJjBDdp5W2EMi347kZ7PFY4_KwJsO5Cgqpj9kW91f6fX6N-8ZpONm6hXbuBuk3igNnJOQyNIEN49-Y7ZRbQSAmkqn5wWcGZtLr093DRU Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: 5023455241594360bacff911a6641d7a Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-AttachVolumeTestJSON-793970641 Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:42:39.194218 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:42:39.195632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5023455241594360bacff911a6641d7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5023455241594360bacff911a6641d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5023455241594360bacff911a6641d7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5023455241594360bacff911a6641d7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:39.195632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-AttachVolumeTestJSON-793970641 Aug 31 00:42:39.195632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: 5023455241594360bacff911a6641d7a Aug 31 00:42:39.195632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-AttachVolumeTestJSON-793970641 Aug 31 00:42:39.195632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-AttachVolumeTestJSON-793970641-project Aug 31 00:42:39.195632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:42:39.195632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:42:39.195632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: ac2476465c4c4bd2b1cf81934b6e9a7d Aug 31 00:42:39.195632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-AttachVolumeTestJSON-793970641-project Aug 31 00:42:39.195632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:42:39.195632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 could not be found. Aug 31 00:42:39.195632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': 'bf8cd0c7-4af8-443b-9f8d-d878cc6137e7'} Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 could not be found. Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:39.196422 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 could not be found. Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 could not be found. Aug 31 00:42:39.198517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:39.199906 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-db8f30d7-db78-43b1-9572-0eb3676509a9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Returning 404 to user: Instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:39.199906 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-db8f30d7-db78-43b1-9572-0eb3676509a9 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 404 len: 111 microversion: 2.1 time: 0.038527 Aug 31 00:42:39.199906 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 515/1008] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:42:39 2022] DELETE /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:39.204916 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-aaad08da-91ca-45e1-8281-2b685b8397a6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:39.205526 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-aaad08da-91ca-45e1-8281-2b685b8397a6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: bf8cd0c7-4af8-443b-9f8d-d878cc6137e7] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:39.211554 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aaad08da-91ca-45e1-8281-2b685b8397a6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:39.212049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aaad08da-91ca-45e1-8281-2b685b8397a6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:39.212531 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aaad08da-91ca-45e1-8281-2b685b8397a6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:39.213675 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aaad08da-91ca-45e1-8281-2b685b8397a6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:39.214322 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aaad08da-91ca-45e1-8281-2b685b8397a6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:39.214756 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-aaad08da-91ca-45e1-8281-2b685b8397a6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:39.230083 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-aaad08da-91ca-45e1-8281-2b685b8397a6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] HTTP exception thrown: Instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 could not be found. Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-aaad08da-91ca-45e1-8281-2b685b8397a6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Request method failure captured: Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 HTTP/1.1 Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDq0WcVgXUj-iqbCzauuWxIXx3hi4_qofZE82BYx5XOikwDxchIHG520fBqtCYl8cHU47fOUFJjBDdp5W2EMi347kZ7PFY4_KwJsO5Cgqpj9kW91f6fX6N-8ZpONm6hXbuBuk3igNnJOQyNIEN49-Y7ZRbQSAmkqn5wWcGZtLr093DRU Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: 5023455241594360bacff911a6641d7a Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-AttachVolumeTestJSON-793970641 Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:42:39.231731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:42:39.233342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5023455241594360bacff911a6641d7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5023455241594360bacff911a6641d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5023455241594360bacff911a6641d7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5023455241594360bacff911a6641d7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:39.233342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-AttachVolumeTestJSON-793970641 Aug 31 00:42:39.233342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: 5023455241594360bacff911a6641d7a Aug 31 00:42:39.233342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-AttachVolumeTestJSON-793970641 Aug 31 00:42:39.233342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-AttachVolumeTestJSON-793970641-project Aug 31 00:42:39.233342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:42:39.233342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:42:39.233342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: ac2476465c4c4bd2b1cf81934b6e9a7d Aug 31 00:42:39.233342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-AttachVolumeTestJSON-793970641-project Aug 31 00:42:39.233342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:42:39.233342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 could not be found. Aug 31 00:42:39.233342 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': 'bf8cd0c7-4af8-443b-9f8d-d878cc6137e7'} Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 could not be found. Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:39.234152 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:39.235391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:39.235391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:42:39.235391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:42:39.235391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:39.235391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:39.235391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:39.235391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:39.235391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 could not be found. Aug 31 00:42:39.235391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:39.235391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:39.235391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:39.235391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:39.235391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:39.235391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:39.235391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:39.235391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:39.235391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 could not be found. Aug 31 00:42:39.235391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:39.236619 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-aaad08da-91ca-45e1-8281-2b685b8397a6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Returning 404 to user: Instance bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:39.236619 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-aaad08da-91ca-45e1-8281-2b685b8397a6 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7" status: 404 len: 111 microversion: 2.1 time: 0.032081 Aug 31 00:42:39.236619 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 516/1009] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:39 2022] GET /compute/v2.1/servers/bf8cd0c7-4af8-443b-9f8d-d878cc6137e7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:42:39.549967 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8f9c616a-17e0-48f5-a416-17ce73e0004a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:39.550876 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8f9c616a-17e0-48f5-a416-17ce73e0004a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:39.558879 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8f9c616a-17e0-48f5-a416-17ce73e0004a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:39.559678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8f9c616a-17e0-48f5-a416-17ce73e0004a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:39.560180 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8f9c616a-17e0-48f5-a416-17ce73e0004a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:39.561082 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8f9c616a-17e0-48f5-a416-17ce73e0004a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:39.561597 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8f9c616a-17e0-48f5-a416-17ce73e0004a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:39.562188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8f9c616a-17e0-48f5-a416-17ce73e0004a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:39.775151 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-404bdc9d-b127-4719-9504-ec2cbed59e1b tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.667117 Aug 31 00:42:39.777040 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 494/1010] 10.222.0.65 () {60 vars in 1162 bytes} [Wed Aug 31 00:42:39 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:39.796097 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-24b5da61-6b38-4cd8-add6-a16eaad8ae28 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f5522388040>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:39.828140 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8f9c616a-17e0-48f5-a416-17ce73e0004a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:39.840196 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8f9c616a-17e0-48f5-a416-17ce73e0004a tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1266 microversion: 2.1 time: 0.292532 Aug 31 00:42:39.840519 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 517/1011] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:39 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:39.848154 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-24b5da61-6b38-4cd8-add6-a16eaad8ae28 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/007e2fac-d72f-45b5-bf46-f82d3370b143" status: 200 len: 287 microversion: 2.1 time: 0.059445 Aug 31 00:42:39.850192 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 495/1012] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 31 00:42:39 2022] GET /compute/v2.1/os-snapshots/007e2fac-d72f-45b5-bf46-f82d3370b143 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:39.869655 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-885d6efa-a221-4b6e-ab22-1dc02a00063c tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f551eabbf70>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:39.910811 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-885d6efa-a221-4b6e-ab22-1dc02a00063c tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.048868 Aug 31 00:42:39.911387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 518/1013] 10.222.0.65 () {58 vars in 1140 bytes} [Wed Aug 31 00:42:39 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:39.923864 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-df89b3da-2578-438b-9a13-78a370a53ae8 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f55222d03a0>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:39.969249 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-1ffb2bfc-5860-4ba3-b06f-604083f4097c req-539b387d-9a4e-4bf4-8b11-c35bab0c61a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238e7167-528f-4320-99b2-344f8683cde6", "name": "network-vif-plugged", "status": "completed", "tag": "d6e8579c-bd80-41e5-85c3-d0906fe6933e"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:42:39.970251 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-df89b3da-2578-438b-9a13-78a370a53ae8 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/007e2fac-d72f-45b5-bf46-f82d3370b143" status: 200 len: 287 microversion: 2.1 time: 0.050323 Aug 31 00:42:39.972064 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 496/1014] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 31 00:42:39 2022] GET /compute/v2.1/os-snapshots/007e2fac-d72f-45b5-bf46-f82d3370b143 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:39.982226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-1ffb2bfc-5860-4ba3-b06f-604083f4097c req-539b387d-9a4e-4bf4-8b11-c35bab0c61a3 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:39.982913 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-1ffb2bfc-5860-4ba3-b06f-604083f4097c req-539b387d-9a4e-4bf4-8b11-c35bab0c61a3 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:39.983607 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-1ffb2bfc-5860-4ba3-b06f-604083f4097c req-539b387d-9a4e-4bf4-8b11-c35bab0c61a3 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:40.004130 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-1ffb2bfc-5860-4ba3-b06f-604083f4097c req-539b387d-9a4e-4bf4-8b11-c35bab0c61a3 service nova] Creating event network-vif-plugged:d6e8579c-bd80-41e5-85c3-d0906fe6933e for instance 238e7167-528f-4320-99b2-344f8683cde6 on hv-cinder-85221 Aug 31 00:42:40.006822 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-1ffb2bfc-5860-4ba3-b06f-604083f4097c req-539b387d-9a4e-4bf4-8b11-c35bab0c61a3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042698 Aug 31 00:42:40.007608 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 519/1015] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:40.571476 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-27e1b0cd-b3d6-4899-a347-a3cfeda6bc20 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:40.572006 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-27e1b0cd-b3d6-4899-a347-a3cfeda6bc20 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:40.578994 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-27e1b0cd-b3d6-4899-a347-a3cfeda6bc20 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:40.579324 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-27e1b0cd-b3d6-4899-a347-a3cfeda6bc20 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:40.579689 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-27e1b0cd-b3d6-4899-a347-a3cfeda6bc20 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:40.580411 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-27e1b0cd-b3d6-4899-a347-a3cfeda6bc20 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:40.580906 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-27e1b0cd-b3d6-4899-a347-a3cfeda6bc20 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:40.581332 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-27e1b0cd-b3d6-4899-a347-a3cfeda6bc20 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:40.596510 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-27e1b0cd-b3d6-4899-a347-a3cfeda6bc20 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] HTTP exception thrown: Instance 07dc2669-6605-431c-93a5-884348c09ebf could not be found. Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-27e1b0cd-b3d6-4899-a347-a3cfeda6bc20 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Request method failure captured: Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: DELETE /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf HTTP/1.1 Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDq0WcVgXUj-iqbCzauuWxIXx3hi4_qofZE82BYx5XOikwDxchIHG520fBqtCYl8cHU47fOUFJjBDdp5W2EMi347kZ7PFY4_KwJsO5Cgqpj9kW91f6fX6N-8ZpONm6hXbuBuk3igNnJOQyNIEN49-Y7ZRbQSAmkqn5wWcGZtLr093DRU Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: 5023455241594360bacff911a6641d7a Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-AttachVolumeTestJSON-793970641 Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:42:40.598859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:42:40.601054 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5023455241594360bacff911a6641d7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5023455241594360bacff911a6641d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5023455241594360bacff911a6641d7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5023455241594360bacff911a6641d7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:40.601054 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-AttachVolumeTestJSON-793970641 Aug 31 00:42:40.601054 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: 5023455241594360bacff911a6641d7a Aug 31 00:42:40.601054 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-AttachVolumeTestJSON-793970641 Aug 31 00:42:40.601054 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-AttachVolumeTestJSON-793970641-project Aug 31 00:42:40.601054 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:42:40.601054 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:42:40.601054 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: ac2476465c4c4bd2b1cf81934b6e9a7d Aug 31 00:42:40.601054 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-AttachVolumeTestJSON-793970641-project Aug 31 00:42:40.601054 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:42:40.601054 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance 07dc2669-6605-431c-93a5-884348c09ebf could not be found. Aug 31 00:42:40.601054 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': '07dc2669-6605-431c-93a5-884348c09ebf'} Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07dc2669-6605-431c-93a5-884348c09ebf could not be found. Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:40.601842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07dc2669-6605-431c-93a5-884348c09ebf could not be found. Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07dc2669-6605-431c-93a5-884348c09ebf could not be found. Aug 31 00:42:40.603044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:40.605905 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-27e1b0cd-b3d6-4899-a347-a3cfeda6bc20 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Returning 404 to user: Instance 07dc2669-6605-431c-93a5-884348c09ebf could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:40.605905 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-27e1b0cd-b3d6-4899-a347-a3cfeda6bc20 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "DELETE /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 404 len: 111 microversion: 2.1 time: 0.032344 Aug 31 00:42:40.605905 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 497/1016] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:42:40 2022] DELETE /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:42:40.610060 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8b8cbaf0-652d-4271-9d45-532de1990272 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:40.610758 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8b8cbaf0-652d-4271-9d45-532de1990272 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] [instance: 07dc2669-6605-431c-93a5-884348c09ebf] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:40.617589 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b8cbaf0-652d-4271-9d45-532de1990272 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:40.618078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b8cbaf0-652d-4271-9d45-532de1990272 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:40.618511 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b8cbaf0-652d-4271-9d45-532de1990272 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:40.619275 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b8cbaf0-652d-4271-9d45-532de1990272 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:40.619932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b8cbaf0-652d-4271-9d45-532de1990272 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:40.620616 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b8cbaf0-652d-4271-9d45-532de1990272 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:40.634189 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-8b8cbaf0-652d-4271-9d45-532de1990272 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] HTTP exception thrown: Instance 07dc2669-6605-431c-93a5-884348c09ebf could not be found. Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8b8cbaf0-652d-4271-9d45-532de1990272 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Request method failure captured: Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf HTTP/1.1 Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDq0WcVgXUj-iqbCzauuWxIXx3hi4_qofZE82BYx5XOikwDxchIHG520fBqtCYl8cHU47fOUFJjBDdp5W2EMi347kZ7PFY4_KwJsO5Cgqpj9kW91f6fX6N-8ZpONm6hXbuBuk3igNnJOQyNIEN49-Y7ZRbQSAmkqn5wWcGZtLr093DRU Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: 5023455241594360bacff911a6641d7a Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-AttachVolumeTestJSON-793970641 Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:42:40.636894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:42:40.638804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5023455241594360bacff911a6641d7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5023455241594360bacff911a6641d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5023455241594360bacff911a6641d7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5023455241594360bacff911a6641d7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:40.638804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-AttachVolumeTestJSON-793970641 Aug 31 00:42:40.638804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: 5023455241594360bacff911a6641d7a Aug 31 00:42:40.638804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-AttachVolumeTestJSON-793970641 Aug 31 00:42:40.638804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-AttachVolumeTestJSON-793970641-project Aug 31 00:42:40.638804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:42:40.638804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:42:40.638804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: ac2476465c4c4bd2b1cf81934b6e9a7d Aug 31 00:42:40.638804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-AttachVolumeTestJSON-793970641-project Aug 31 00:42:40.638804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:42:40.638804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance 07dc2669-6605-431c-93a5-884348c09ebf could not be found. Aug 31 00:42:40.638804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': '07dc2669-6605-431c-93a5-884348c09ebf'} Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07dc2669-6605-431c-93a5-884348c09ebf could not be found. Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:40.639730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:40.641731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:40.641731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:42:40.641731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:42:40.641731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:42:40.641731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:42:40.641731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:42:40.641731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:40.641731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07dc2669-6605-431c-93a5-884348c09ebf could not be found. Aug 31 00:42:40.641731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:40.641731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:40.641731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:40.641731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:40.641731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:40.641731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:40.641731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:40.641731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:40.641731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07dc2669-6605-431c-93a5-884348c09ebf could not be found. Aug 31 00:42:40.641731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:40.643525 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8b8cbaf0-652d-4271-9d45-532de1990272 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] Returning 404 to user: Instance 07dc2669-6605-431c-93a5-884348c09ebf could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:40.643525 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8b8cbaf0-652d-4271-9d45-532de1990272 tempest-AttachVolumeTestJSON-793970641 tempest-AttachVolumeTestJSON-793970641-project] 10.222.0.65 "GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf" status: 404 len: 111 microversion: 2.1 time: 0.031769 Aug 31 00:42:40.643525 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 520/1017] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:40 2022] GET /compute/v2.1/servers/07dc2669-6605-431c-93a5-884348c09ebf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:40.864701 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f618f48f-8a27-4717-8f82-34050718bc0b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:40.865320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-f618f48f-8a27-4717-8f82-34050718bc0b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:40.871431 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f618f48f-8a27-4717-8f82-34050718bc0b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:40.872005 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f618f48f-8a27-4717-8f82-34050718bc0b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:40.872407 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f618f48f-8a27-4717-8f82-34050718bc0b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:40.873037 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f618f48f-8a27-4717-8f82-34050718bc0b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:40.873481 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f618f48f-8a27-4717-8f82-34050718bc0b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:40.874105 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f618f48f-8a27-4717-8f82-34050718bc0b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:40.984441 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b7fc8fb6-046b-4cb2-bbc9-844672d0784c tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f551eaccca0>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:41.016929 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-b7fc8fb6-046b-4cb2-bbc9-844672d0784c tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/007e2fac-d72f-45b5-bf46-f82d3370b143" status: 200 len: 287 microversion: 2.1 time: 0.036318 Aug 31 00:42:41.017785 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 521/1018] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 31 00:42:40 2022] GET /compute/v2.1/os-snapshots/007e2fac-d72f-45b5-bf46-f82d3370b143 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:42:41.138041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f618f48f-8a27-4717-8f82-34050718bc0b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:41.145813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f618f48f-8a27-4717-8f82-34050718bc0b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1266 microversion: 2.1 time: 0.288275 Aug 31 00:42:41.159665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 498/1019] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:40 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:42:42.032676 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-10d7b43e-49ee-4c3d-8bb4-ae3a1f0200e1 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f551e95df70>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:42.091965 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-10d7b43e-49ee-4c3d-8bb4-ae3a1f0200e1 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/007e2fac-d72f-45b5-bf46-f82d3370b143" status: 200 len: 287 microversion: 2.1 time: 0.065098 Aug 31 00:42:42.092552 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 522/1020] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 31 00:42:42 2022] GET /compute/v2.1/os-snapshots/007e2fac-d72f-45b5-bf46-f82d3370b143 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:42.167985 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-b3662168-e788-4e83-b409-df2d57058405 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:42.168641 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-b3662168-e788-4e83-b409-df2d57058405 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:42.175034 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b3662168-e788-4e83-b409-df2d57058405 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:42.175515 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b3662168-e788-4e83-b409-df2d57058405 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:42.175944 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b3662168-e788-4e83-b409-df2d57058405 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:42.176656 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b3662168-e788-4e83-b409-df2d57058405 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:42.177105 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b3662168-e788-4e83-b409-df2d57058405 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:42.177523 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b3662168-e788-4e83-b409-df2d57058405 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:42.393812 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b3662168-e788-4e83-b409-df2d57058405 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:42.403945 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-b3662168-e788-4e83-b409-df2d57058405 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1266 microversion: 2.1 time: 0.240801 Aug 31 00:42:42.405181 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 499/1021] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:42 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:43.107371 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-e2b8a469-7dc5-42cc-8784-ce07701251b3 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f551eab7670>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:43.165599 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-e2b8a469-7dc5-42cc-8784-ce07701251b3 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/007e2fac-d72f-45b5-bf46-f82d3370b143" status: 200 len: 287 microversion: 2.1 time: 0.063969 Aug 31 00:42:43.167991 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 523/1022] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 31 00:42:43 2022] GET /compute/v2.1/os-snapshots/007e2fac-d72f-45b5-bf46-f82d3370b143 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:43.435149 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-53ca2019-7b07-43d2-9b03-eef352eb46b8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:43.436670 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-53ca2019-7b07-43d2-9b03-eef352eb46b8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:43.449257 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-53ca2019-7b07-43d2-9b03-eef352eb46b8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:43.449975 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-53ca2019-7b07-43d2-9b03-eef352eb46b8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:43.451719 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-53ca2019-7b07-43d2-9b03-eef352eb46b8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:43.453944 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-53ca2019-7b07-43d2-9b03-eef352eb46b8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:43.459108 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-53ca2019-7b07-43d2-9b03-eef352eb46b8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:43.459108 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-53ca2019-7b07-43d2-9b03-eef352eb46b8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:43.729950 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-53ca2019-7b07-43d2-9b03-eef352eb46b8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:43.751525 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-53ca2019-7b07-43d2-9b03-eef352eb46b8 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1266 microversion: 2.1 time: 0.321673 Aug 31 00:42:43.756705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 500/1023] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:43 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1266 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:44.179706 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-396f622d-4408-4365-8bde-4cdafb46ec83 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f551e9d0e50>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:44.229568 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-396f622d-4408-4365-8bde-4cdafb46ec83 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/007e2fac-d72f-45b5-bf46-f82d3370b143" status: 200 len: 288 microversion: 2.1 time: 0.054177 Aug 31 00:42:44.232013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 524/1024] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 31 00:42:44 2022] GET /compute/v2.1/os-snapshots/007e2fac-d72f-45b5-bf46-f82d3370b143 => generated 288 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:44.247585 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-3b71126b-4947-4196-80ad-b18809940a88 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f552231f700>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:44.444792 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-3b71126b-4947-4196-80ad-b18809940a88 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "DELETE /compute/v2.1/os-snapshots/007e2fac-d72f-45b5-bf46-f82d3370b143" status: 202 len: 0 microversion: 2.1 time: 0.203295 Aug 31 00:42:44.445543 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 501/1025] 10.222.0.65 () {58 vars in 1254 bytes} [Wed Aug 31 00:42:44 2022] DELETE /compute/v2.1/os-snapshots/007e2fac-d72f-45b5-bf46-f82d3370b143 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:42:44.456982 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-7032819f-c1f6-4e61-91ed-be4160265f2c tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f551ea15820>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:44.514255 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-7032819f-c1f6-4e61-91ed-be4160265f2c tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/007e2fac-d72f-45b5-bf46-f82d3370b143" status: 200 len: 287 microversion: 2.1 time: 0.063202 Aug 31 00:42:44.515219 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 525/1026] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 31 00:42:44 2022] GET /compute/v2.1/os-snapshots/007e2fac-d72f-45b5-bf46-f82d3370b143 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:44.783720 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9f5bc127-6920-4223-8b4b-a9d643b00eba tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:44.785060 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9f5bc127-6920-4223-8b4b-a9d643b00eba tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:44.816947 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f5bc127-6920-4223-8b4b-a9d643b00eba tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:44.817528 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f5bc127-6920-4223-8b4b-a9d643b00eba tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:44.817977 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f5bc127-6920-4223-8b4b-a9d643b00eba tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:44.818719 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f5bc127-6920-4223-8b4b-a9d643b00eba tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:44.819175 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f5bc127-6920-4223-8b4b-a9d643b00eba tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:44.827119 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9f5bc127-6920-4223-8b4b-a9d643b00eba tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:45.140483 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-9f5bc127-6920-4223-8b4b-a9d643b00eba tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:45.166973 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9f5bc127-6920-4223-8b4b-a9d643b00eba tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1266 microversion: 2.1 time: 0.396464 Aug 31 00:42:45.193400 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 502/1027] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:44 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1266 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:45.539646 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-39c28158-9948-4d7b-81a1-37e105596f22 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f551eab7310>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:45.579287 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-39c28158-9948-4d7b-81a1-37e105596f22 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] HTTP exception thrown: Snapshot 007e2fac-d72f-45b5-bf46-f82d3370b143 could not be found. Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-39c28158-9948-4d7b-81a1-37e105596f22 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Request method failure captured: Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/os-snapshots/007e2fac-d72f-45b5-bf46-f82d3370b143 HTTP/1.1 Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDq55T4wk6mMhzerd9VKPQD9-MsfmCirdxgIpAJ_W4qm9QbcQp50lo8q75AXpEKIURJL4I8VoKy2_Va7NdVswgWzuArIEYfvVk9bLOcsDj4YmlDW7jw6_3GQdDQ1kbr3zjW6_cKOEvoEXEkzlZH68m9zk2qqBBP3Bf_e-Q9rMViekfQA Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: 0e10d533d2554163adf398bba7f7acd1 Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1166833046 Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:42:45.582086 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:42:45.583612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0e10d533d2554163adf398bba7f7acd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0e10d533d2554163adf398bba7f7acd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0e10d533d2554163adf398bba7f7acd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0e10d533d2554163adf398bba7f7acd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:45.583612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1166833046 Aug 31 00:42:45.583612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: 0e10d533d2554163adf398bba7f7acd1 Aug 31 00:42:45.583612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1166833046 Aug 31 00:42:45.583612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-VolumesSnapshotsTestJSON-1166833046-project Aug 31 00:42:45.583612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:42:45.583612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:42:45.583612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 7c0bb02b4eba4eb785114f6582b25a16 Aug 31 00:42:45.583612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1166833046-project Aug 31 00:42:45.583612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: Aug 31 00:42:45.583612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Snapshot 007e2fac-d72f-45b5-bf46-f82d3370b143 could not be found. Aug 31 00:42:45.583612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': '007e2fac-d72f-45b5-bf46-f82d3370b143'} Aug 31 00:42:45.583612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:45.584644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:45.584644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 00:42:45.584644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 00:42:45.584644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 00:42:45.584644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 00:42:45.584644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 00:42:45.584644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 00:42:45.584644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:42:45.584644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:42:45.584644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:42:45.584644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:42:45.584644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:42:45.584644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:42:45.584644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:42:45.584644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:42:45.584644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 007e2fac-d72f-45b5-bf46-f82d3370b143 could not be found. (HTTP 404) (Request-ID: req-e04737c1-db19-4409-bc21-42abf36dfd5c) Aug 31 00:42:45.584644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:45.584644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:45.589528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:45.589528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:45.589528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 00:42:45.589528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 00:42:45.589528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:42:45.589528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:42:45.589528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 00:42:45.589528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 00:42:45.589528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:42:45.589528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:42:45.589528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 00:42:45.589528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 00:42:45.589528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 00:42:45.589528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 00:42:45.589528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 00:42:45.589528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 00:42:45.589528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:42:45.589528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:42:45.589528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 007e2fac-d72f-45b5-bf46-f82d3370b143 could not be found. Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 00:42:45.590908 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:45.597536 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 007e2fac-d72f-45b5-bf46-f82d3370b143 could not be found. Aug 31 00:42:45.597536 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:45.597536 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:45.597536 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:45.597536 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:45.597536 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:45.597536 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:45.597536 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:45.597536 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:45.597536 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 007e2fac-d72f-45b5-bf46-f82d3370b143 could not be found. Aug 31 00:42:45.597536 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:45.597536 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-39c28158-9948-4d7b-81a1-37e105596f22 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Returning 404 to user: Snapshot 007e2fac-d72f-45b5-bf46-f82d3370b143 could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:45.597536 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-39c28158-9948-4d7b-81a1-37e105596f22 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/007e2fac-d72f-45b5-bf46-f82d3370b143" status: 404 len: 111 microversion: 2.1 time: 0.057904 Aug 31 00:42:45.598482 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 526/1028] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 31 00:42:45 2022] GET /compute/v2.1/os-snapshots/007e2fac-d72f-45b5-bf46-f82d3370b143 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:45.598585 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-afdd8bd7-cd92-4e4b-86c4-b42c779e14a3 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f551ebdde50>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:45.846262 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-afdd8bd7-cd92-4e4b-86c4-b42c779e14a3 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e" status: 202 len: 0 microversion: 2.1 time: 0.256343 Aug 31 00:42:45.846880 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 503/1029] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 00:42:45 2022] DELETE /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:42:45.858219 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-5cc657df-9420-49be-9b8c-294421faef56 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f551e9d0f70>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:45.942102 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-5cc657df-9420-49be-9b8c-294421faef56 tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e" status: 200 len: 344 microversion: 2.1 time: 0.064827 Aug 31 00:42:45.942102 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 527/1030] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 00:42:45 2022] GET /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:42:46.192799 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-197cff4f-8373-40e4-8501-f6898ec7f4f5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:46.193319 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-197cff4f-8373-40e4-8501-f6898ec7f4f5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:46.199829 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-197cff4f-8373-40e4-8501-f6898ec7f4f5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:46.200304 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-197cff4f-8373-40e4-8501-f6898ec7f4f5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:46.200860 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-197cff4f-8373-40e4-8501-f6898ec7f4f5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:46.201546 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-197cff4f-8373-40e4-8501-f6898ec7f4f5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:46.201992 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-197cff4f-8373-40e4-8501-f6898ec7f4f5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:46.202409 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-197cff4f-8373-40e4-8501-f6898ec7f4f5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:46.430763 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-197cff4f-8373-40e4-8501-f6898ec7f4f5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:46.444526 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-197cff4f-8373-40e4-8501-f6898ec7f4f5 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1453 microversion: 2.1 time: 0.253605 Aug 31 00:42:46.445359 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 504/1031] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:46 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1453 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:46.473905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-fb10dc41-05e5-4e7e-8414-20a96776c842 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:46.474778 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-fb10dc41-05e5-4e7e-8414-20a96776c842 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:42:46.484715 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fb10dc41-05e5-4e7e-8414-20a96776c842 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:46.489569 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fb10dc41-05e5-4e7e-8414-20a96776c842 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:46.490994 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fb10dc41-05e5-4e7e-8414-20a96776c842 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:46.491737 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fb10dc41-05e5-4e7e-8414-20a96776c842 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:46.493365 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fb10dc41-05e5-4e7e-8414-20a96776c842 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:46.493365 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fb10dc41-05e5-4e7e-8414-20a96776c842 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:46.677668 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-fb10dc41-05e5-4e7e-8414-20a96776c842 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:42:46.689573 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-fb10dc41-05e5-4e7e-8414-20a96776c842 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1453 microversion: 2.1 time: 0.219738 Aug 31 00:42:46.690402 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 528/1032] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:42:46 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1453 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:42:46.955348 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-6cb2e30b-eb0b-403c-84e4-7ee62a027c7a tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f552231fb80>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:47.032613 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-6cb2e30b-eb0b-403c-84e4-7ee62a027c7a tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] HTTP exception thrown: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-6cb2e30b-eb0b-403c-84e4-7ee62a027c7a tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Request method failure captured: Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: GET /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e HTTP/1.1 Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDq55T4wk6mMhzerd9VKPQD9-MsfmCirdxgIpAJ_W4qm9QbcQp50lo8q75AXpEKIURJL4I8VoKy2_Va7NdVswgWzuArIEYfvVk9bLOcsDj4YmlDW7jw6_3GQdDQ1kbr3zjW6_cKOEvoEXEkzlZH68m9zk2qqBBP3Bf_e-Q9rMViekfQA Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: 0e10d533d2554163adf398bba7f7acd1 Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1166833046 Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:42:47.035573 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:42:47.036998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0e10d533d2554163adf398bba7f7acd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0e10d533d2554163adf398bba7f7acd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0e10d533d2554163adf398bba7f7acd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0e10d533d2554163adf398bba7f7acd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:47.036998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1166833046 Aug 31 00:42:47.036998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: 0e10d533d2554163adf398bba7f7acd1 Aug 31 00:42:47.036998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1166833046 Aug 31 00:42:47.036998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-VolumesSnapshotsTestJSON-1166833046-project Aug 31 00:42:47.036998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:42:47.036998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:42:47.036998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 7c0bb02b4eba4eb785114f6582b25a16 Aug 31 00:42:47.036998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1166833046-project Aug 31 00:42:47.036998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: Aug 31 00:42:47.036998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. Aug 31 00:42:47.036998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': 'd48f39f4-3c5a-4239-bb8c-612f6685d96e'} Aug 31 00:42:47.036998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:47.037798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:47.037798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:42:47.037798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:42:47.037798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:42:47.037798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:42:47.037798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:42:47.037798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:42:47.037798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:42:47.037798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:42:47.037798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:42:47.037798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:42:47.037798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:42:47.037798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:42:47.037798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:42:47.037798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:42:47.037798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. (HTTP 404) (Request-ID: req-99b37bad-4b55-40ac-a76d-6bbb4f9c9bb1) Aug 31 00:42:47.037798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.037798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:47.037798 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.039616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:47.039616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 00:42:47.039616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 00:42:47.039616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:42:47.039616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:42:47.039616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:42:47.039616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:42:47.039616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:42:47.039616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:42:47.039616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:42:47.039616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:42:47.039616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:42:47.039616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:42:47.039616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:42:47.039616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:42:47.039616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:42:47.039616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:42:47.039616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:42:47.039616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:42:47.040813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:42:47.040813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:42:47.040813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:42:47.040813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:42:47.040813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. Aug 31 00:42:47.040813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.040813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:47.040813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.040813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:47.040813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:47.040813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:47.040813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:47.040813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:47.040813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:42:47.040813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:42:47.040813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:47.040813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:47.040813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 00:42:47.040813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:47.041998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. Aug 31 00:42:47.041998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.041998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:47.041998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.041998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:47.041998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:47.041998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:47.041998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:47.041998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:47.041998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. Aug 31 00:42:47.041998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.041998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-6cb2e30b-eb0b-403c-84e4-7ee62a027c7a tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Returning 404 to user: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:47.041998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-6cb2e30b-eb0b-403c-84e4-7ee62a027c7a tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e" status: 404 len: 109 microversion: 2.1 time: 0.086277 Aug 31 00:42:47.041998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 505/1033] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 00:42:46 2022] GET /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:47.052566 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d730cf22-a950-4b18-84bc-401b8756c95e tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f551eacc940>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:47.104612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-d730cf22-a950-4b18-84bc-401b8756c95e tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] HTTP exception thrown: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d730cf22-a950-4b18-84bc-401b8756c95e tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Request method failure captured: Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: DELETE /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e HTTP/1.1 Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDq55T4wk6mMhzerd9VKPQD9-MsfmCirdxgIpAJ_W4qm9QbcQp50lo8q75AXpEKIURJL4I8VoKy2_Va7NdVswgWzuArIEYfvVk9bLOcsDj4YmlDW7jw6_3GQdDQ1kbr3zjW6_cKOEvoEXEkzlZH68m9zk2qqBBP3Bf_e-Q9rMViekfQA Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: 0e10d533d2554163adf398bba7f7acd1 Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1166833046 Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:42:47.107019 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:42:47.113795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0e10d533d2554163adf398bba7f7acd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0e10d533d2554163adf398bba7f7acd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0e10d533d2554163adf398bba7f7acd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0e10d533d2554163adf398bba7f7acd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:47.113795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1166833046 Aug 31 00:42:47.113795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: 0e10d533d2554163adf398bba7f7acd1 Aug 31 00:42:47.113795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1166833046 Aug 31 00:42:47.113795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-VolumesSnapshotsTestJSON-1166833046-project Aug 31 00:42:47.113795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:42:47.113795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:42:47.113795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 7c0bb02b4eba4eb785114f6582b25a16 Aug 31 00:42:47.113795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1166833046-project Aug 31 00:42:47.113795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: Aug 31 00:42:47.113795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. Aug 31 00:42:47.113795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': 'd48f39f4-3c5a-4239-bb8c-612f6685d96e'} Aug 31 00:42:47.113795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:47.114733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:47.114733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:42:47.114733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:42:47.114733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:42:47.114733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:42:47.114733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:42:47.114733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:42:47.114733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:42:47.114733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:42:47.114733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:42:47.114733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:42:47.114733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:42:47.114733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:42:47.114733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:42:47.114733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:42:47.114733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. (HTTP 404) (Request-ID: req-479c32ee-faf0-41f0-9396-12d254143131) Aug 31 00:42:47.114733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.114733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:47.114733 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.115950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:47.115950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 00:42:47.115950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 00:42:47.115950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:42:47.115950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:42:47.115950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:42:47.115950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:42:47.115950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:42:47.115950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:42:47.115950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:42:47.115950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:42:47.115950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 00:42:47.115950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 00:42:47.115950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 00:42:47.115950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 00:42:47.115950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 00:42:47.115950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 00:42:47.115950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 00:42:47.115950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 00:42:47.117431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:42:47.117431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:42:47.117431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:42:47.117431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:42:47.117431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. Aug 31 00:42:47.117431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.117431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:47.117431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.117431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:47.117431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:47.117431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:47.117431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:47.117431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:47.117431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:42:47.117431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:42:47.117431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:47.117431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:47.117431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 00:42:47.117431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:47.120008 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. Aug 31 00:42:47.120008 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.120008 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:47.120008 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.120008 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:47.120008 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:47.120008 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:47.120008 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:47.120008 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:47.120008 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. Aug 31 00:42:47.120008 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.120008 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d730cf22-a950-4b18-84bc-401b8756c95e tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Returning 404 to user: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:47.120008 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d730cf22-a950-4b18-84bc-401b8756c95e tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e" status: 404 len: 109 microversion: 2.1 time: 0.061021 Aug 31 00:42:47.121621 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 529/1034] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 31 00:42:47 2022] DELETE /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:47.123317 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a34e5932-8c47-4f45-976a-52435bc756ed tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Calling method '.version_select at 0x7f5522325550>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:42:47.163606 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-a34e5932-8c47-4f45-976a-52435bc756ed tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] HTTP exception thrown: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a34e5932-8c47-4f45-976a-52435bc756ed tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Request method failure captured: Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: GET /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e HTTP/1.1 Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDq55T4wk6mMhzerd9VKPQD9-MsfmCirdxgIpAJ_W4qm9QbcQp50lo8q75AXpEKIURJL4I8VoKy2_Va7NdVswgWzuArIEYfvVk9bLOcsDj4YmlDW7jw6_3GQdDQ1kbr3zjW6_cKOEvoEXEkzlZH68m9zk2qqBBP3Bf_e-Q9rMViekfQA Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: 0e10d533d2554163adf398bba7f7acd1 Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1166833046 Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:42:47.166764 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:42:47.168471 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0e10d533d2554163adf398bba7f7acd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0e10d533d2554163adf398bba7f7acd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0e10d533d2554163adf398bba7f7acd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0e10d533d2554163adf398bba7f7acd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:42:47.168471 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1166833046 Aug 31 00:42:47.168471 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: 0e10d533d2554163adf398bba7f7acd1 Aug 31 00:42:47.168471 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1166833046 Aug 31 00:42:47.168471 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-VolumesSnapshotsTestJSON-1166833046-project Aug 31 00:42:47.168471 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:42:47.168471 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:42:47.168471 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 7c0bb02b4eba4eb785114f6582b25a16 Aug 31 00:42:47.168471 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1166833046-project Aug 31 00:42:47.168471 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: Aug 31 00:42:47.168471 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. Aug 31 00:42:47.168471 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': 'd48f39f4-3c5a-4239-bb8c-612f6685d96e'} Aug 31 00:42:47.168471 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:42:47.169441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:47.169441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:42:47.169441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:42:47.169441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:42:47.169441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:42:47.169441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:42:47.169441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:42:47.169441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:42:47.169441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:42:47.169441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:42:47.169441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:42:47.169441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:42:47.169441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:42:47.169441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:42:47.169441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:42:47.169441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. (HTTP 404) (Request-ID: req-a271c8f1-88d4-4dad-a48c-3b13de00fe28) Aug 31 00:42:47.169441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.169441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:47.169441 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.170751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:47.170751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 00:42:47.170751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 00:42:47.170751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 00:42:47.170751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 00:42:47.170751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 00:42:47.170751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 00:42:47.170751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 00:42:47.170751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 00:42:47.170751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 00:42:47.170751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 00:42:47.170751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 00:42:47.170751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 00:42:47.170751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 00:42:47.170751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 00:42:47.170751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 00:42:47.170751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 00:42:47.170751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 00:42:47.170751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 00:42:47.172056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 00:42:47.172056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 00:42:47.172056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 00:42:47.172056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 00:42:47.172056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. Aug 31 00:42:47.172056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.172056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:47.172056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.172056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:47.172056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:47.172056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:47.172056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:42:47.172056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:42:47.172056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 00:42:47.172056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 00:42:47.172056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:42:47.172056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:42:47.172056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 00:42:47.172056 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:42:47.173426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. Aug 31 00:42:47.173426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.173426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:42:47.173426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.173426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:42:47.173426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:42:47.173426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:42:47.173426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:42:47.173426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:42:47.173426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. Aug 31 00:42:47.173426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:42:47.173426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a34e5932-8c47-4f45-976a-52435bc756ed tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] Returning 404 to user: Volume d48f39f4-3c5a-4239-bb8c-612f6685d96e could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:42:47.173426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a34e5932-8c47-4f45-976a-52435bc756ed tempest-VolumesSnapshotsTestJSON-1166833046 tempest-VolumesSnapshotsTestJSON-1166833046-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e" status: 404 len: 109 microversion: 2.1 time: 0.053992 Aug 31 00:42:47.173426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 506/1035] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 31 00:42:47 2022] GET /compute/v2.1/os-volumes/d48f39f4-3c5a-4239-bb8c-612f6685d96e => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:50.631225 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-564852ee-9ac7-45cd-9a3d-fb1aedf27e09 req-e4f6e8be-3545-481f-8898-7f8c85e1e530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "238e7167-528f-4320-99b2-344f8683cde6", "tag": "d6e8579c-bd80-41e5-85c3-d0906fe6933e"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:42:50.644229 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-564852ee-9ac7-45cd-9a3d-fb1aedf27e09 req-e4f6e8be-3545-481f-8898-7f8c85e1e530 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:42:50.644738 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-564852ee-9ac7-45cd-9a3d-fb1aedf27e09 req-e4f6e8be-3545-481f-8898-7f8c85e1e530 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:42:50.645171 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-564852ee-9ac7-45cd-9a3d-fb1aedf27e09 req-e4f6e8be-3545-481f-8898-7f8c85e1e530 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:42:50.658470 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-564852ee-9ac7-45cd-9a3d-fb1aedf27e09 req-e4f6e8be-3545-481f-8898-7f8c85e1e530 service nova] Creating event network-changed:d6e8579c-bd80-41e5-85c3-d0906fe6933e for instance 238e7167-528f-4320-99b2-344f8683cde6 on hv-cinder-85221 Aug 31 00:42:50.665355 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-564852ee-9ac7-45cd-9a3d-fb1aedf27e09 req-e4f6e8be-3545-481f-8898-7f8c85e1e530 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043266 Aug 31 00:42:50.667084 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 530/1036] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:43:14.050196 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=15 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:14.051077 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=63 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:14.055081 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-bdacba0e-ae55-4437-bdf1-7abff7e333cf tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1516752910", "imageRef": "12947ed8-8ca9-442d-9224-509e79a198e7", "flavorRef": "452", "networks": [{"uuid": "ad14b10b-3e63-42af-b57a-cefcc3328996"}]}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:43:14.113901 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.network.neutron [None req-bdacba0e-ae55-4437-bdf1-7abff7e333cf tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] validate_networks() for [('ad14b10b-3e63-42af-b57a-cefcc3328996', None, None, None, None, None)] {{(pid=128048) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:43:14.533765 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-bdacba0e-ae55-4437-bdf1-7abff7e333cf tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Flavor limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:43:14.534191 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-bdacba0e-ae55-4437-bdf1-7abff7e333cf tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Image limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:43:14.534723 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-bdacba0e-ae55-4437-bdf1-7abff7e333cf tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Flavor pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:43:14.535050 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-bdacba0e-ae55-4437-bdf1-7abff7e333cf tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Image pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:43:14.535668 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-bdacba0e-ae55-4437-bdf1-7abff7e333cf tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:43:14.547151 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bdacba0e-ae55-4437-bdf1-7abff7e333cf tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:14.547775 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bdacba0e-ae55-4437-bdf1-7abff7e333cf tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:14.548476 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bdacba0e-ae55-4437-bdf1-7abff7e333cf tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:14.549210 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bdacba0e-ae55-4437-bdf1-7abff7e333cf tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:14.549817 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bdacba0e-ae55-4437-bdf1-7abff7e333cf tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:14.550337 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bdacba0e-ae55-4437-bdf1-7abff7e333cf tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:14.569224 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-bdacba0e-ae55-4437-bdf1-7abff7e333cf tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Getting quotas for project 644ca4166ff846fb944c2b39f0263abe. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:43:14.574150 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-bdacba0e-ae55-4437-bdf1-7abff7e333cf tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Getting quotas for user 4c936369a3ff4138833cfc81a1104f20 and project 644ca4166ff846fb944c2b39f0263abe. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:43:14.586814 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-bdacba0e-ae55-4437-bdf1-7abff7e333cf tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Going to run 1 instances... {{(pid=128048) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:43:14.600550 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-bdacba0e-ae55-4437-bdf1-7abff7e333cf tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12947ed8-8ca9-442d-9224-509e79a198e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128048) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:43:14.731842 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-bdacba0e-ae55-4437-bdf1-7abff7e333cf tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683255 Aug 31 00:43:14.732834 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 507/1037] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:43:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:43:14.742318 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=17 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:14.743089 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:14.747678 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0b706417-47a5-4895-8d01-0721cacb5a9d tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:14.761575 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-0b706417-47a5-4895-8d01-0721cacb5a9d tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:14.833671 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-0b706417-47a5-4895-8d01-0721cacb5a9d tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:43:14.842960 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-0b706417-47a5-4895-8d01-0721cacb5a9d tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1219 microversion: 2.1 time: 0.102252 Aug 31 00:43:14.843541 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 531/1038] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:43:14 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:43:15.867568 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-4a64d2ca-50cf-4e71-8f1a-ddb3cb5373ea tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:15.868257 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-4a64d2ca-50cf-4e71-8f1a-ddb3cb5373ea tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:15.923147 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4a64d2ca-50cf-4e71-8f1a-ddb3cb5373ea tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:43:15.931135 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-4a64d2ca-50cf-4e71-8f1a-ddb3cb5373ea tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1219 microversion: 2.1 time: 0.067923 Aug 31 00:43:15.931876 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 508/1039] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:43:15 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:43:16.953254 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8ef0443f-893d-4ce6-b38a-9df0e76c7f6f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:16.953855 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8ef0443f-893d-4ce6-b38a-9df0e76c7f6f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:16.966178 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8ef0443f-893d-4ce6-b38a-9df0e76c7f6f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:16.966697 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8ef0443f-893d-4ce6-b38a-9df0e76c7f6f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:16.967141 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8ef0443f-893d-4ce6-b38a-9df0e76c7f6f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:16.967854 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8ef0443f-893d-4ce6-b38a-9df0e76c7f6f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:16.968311 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8ef0443f-893d-4ce6-b38a-9df0e76c7f6f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:16.968769 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8ef0443f-893d-4ce6-b38a-9df0e76c7f6f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:17.033999 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8ef0443f-893d-4ce6-b38a-9df0e76c7f6f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:43:17.042517 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8ef0443f-893d-4ce6-b38a-9df0e76c7f6f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1271 microversion: 2.1 time: 0.093220 Aug 31 00:43:17.043081 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 532/1040] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:43:16 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:43:18.064903 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-1d940ca7-3752-4706-af63-91936849816f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:18.065644 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-1d940ca7-3752-4706-af63-91936849816f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:18.074722 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1d940ca7-3752-4706-af63-91936849816f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:18.076541 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1d940ca7-3752-4706-af63-91936849816f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:18.077201 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1d940ca7-3752-4706-af63-91936849816f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:18.078237 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1d940ca7-3752-4706-af63-91936849816f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:18.078909 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1d940ca7-3752-4706-af63-91936849816f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:18.079562 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1d940ca7-3752-4706-af63-91936849816f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:18.160058 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-1d940ca7-3752-4706-af63-91936849816f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:43:18.170439 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-1d940ca7-3752-4706-af63-91936849816f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1279 microversion: 2.1 time: 0.109217 Aug 31 00:43:18.171711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 509/1041] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:43:18 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1279 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:43:19.194414 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-846336aa-5ce4-4c78-8e71-f4fb09c8b948 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:19.194952 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-846336aa-5ce4-4c78-8e71-f4fb09c8b948 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:19.202633 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-846336aa-5ce4-4c78-8e71-f4fb09c8b948 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:19.203124 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-846336aa-5ce4-4c78-8e71-f4fb09c8b948 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:19.203557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-846336aa-5ce4-4c78-8e71-f4fb09c8b948 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:19.204278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-846336aa-5ce4-4c78-8e71-f4fb09c8b948 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:19.204778 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-846336aa-5ce4-4c78-8e71-f4fb09c8b948 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:19.205225 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-846336aa-5ce4-4c78-8e71-f4fb09c8b948 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:19.362767 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-846336aa-5ce4-4c78-8e71-f4fb09c8b948 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:43:19.371183 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-846336aa-5ce4-4c78-8e71-f4fb09c8b948 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1319 microversion: 2.1 time: 0.181209 Aug 31 00:43:19.371755 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 533/1042] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:43:19 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:43:19.698694 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-b9d4498c-c155-431e-b008-cc6c41f239fa req-017b8066-5228-4407-85b9-7bf6853ad943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cebf9a2d-edf8-47d6-b21f-0d46098c892d", "tag": "61a0644d-28a8-4474-8196-ce23254712ab"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:43:19.711221 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-b9d4498c-c155-431e-b008-cc6c41f239fa req-017b8066-5228-4407-85b9-7bf6853ad943 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:19.711985 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-b9d4498c-c155-431e-b008-cc6c41f239fa req-017b8066-5228-4407-85b9-7bf6853ad943 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:19.713168 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-b9d4498c-c155-431e-b008-cc6c41f239fa req-017b8066-5228-4407-85b9-7bf6853ad943 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:19.726130 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-b9d4498c-c155-431e-b008-cc6c41f239fa req-017b8066-5228-4407-85b9-7bf6853ad943 service nova] Creating event network-changed:61a0644d-28a8-4474-8196-ce23254712ab for instance cebf9a2d-edf8-47d6-b21f-0d46098c892d on hv-cinder-85221 Aug 31 00:43:19.732897 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-b9d4498c-c155-431e-b008-cc6c41f239fa req-017b8066-5228-4407-85b9-7bf6853ad943 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038427 Aug 31 00:43:19.733857 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 510/1043] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:20.398791 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4ffb36dc-2437-406d-bb97-6d03261b76e8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:20.399867 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4ffb36dc-2437-406d-bb97-6d03261b76e8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:20.408971 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4ffb36dc-2437-406d-bb97-6d03261b76e8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:20.409461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4ffb36dc-2437-406d-bb97-6d03261b76e8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:20.409893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4ffb36dc-2437-406d-bb97-6d03261b76e8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:20.410799 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4ffb36dc-2437-406d-bb97-6d03261b76e8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:20.411249 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4ffb36dc-2437-406d-bb97-6d03261b76e8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:20.411889 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4ffb36dc-2437-406d-bb97-6d03261b76e8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:20.626822 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4ffb36dc-2437-406d-bb97-6d03261b76e8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:43:20.636998 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4ffb36dc-2437-406d-bb97-6d03261b76e8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1319 microversion: 2.1 time: 0.243933 Aug 31 00:43:20.638794 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 534/1044] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:43:20 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:43:21.660422 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-18050e8e-aed6-42db-93f7-bf489e351873 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:21.661188 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-18050e8e-aed6-42db-93f7-bf489e351873 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:21.671911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-18050e8e-aed6-42db-93f7-bf489e351873 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:21.671911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-18050e8e-aed6-42db-93f7-bf489e351873 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:21.671911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-18050e8e-aed6-42db-93f7-bf489e351873 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:21.671911 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-18050e8e-aed6-42db-93f7-bf489e351873 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:21.672380 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-18050e8e-aed6-42db-93f7-bf489e351873 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:21.672380 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-18050e8e-aed6-42db-93f7-bf489e351873 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:21.869560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-18050e8e-aed6-42db-93f7-bf489e351873 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:43:21.879690 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-18050e8e-aed6-42db-93f7-bf489e351873 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1319 microversion: 2.1 time: 0.223986 Aug 31 00:43:21.880643 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 511/1045] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:43:21 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:43:22.902819 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-39b8c5a8-faab-4244-84ed-0db67f85391a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:22.903438 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-39b8c5a8-faab-4244-84ed-0db67f85391a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:22.909866 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-39b8c5a8-faab-4244-84ed-0db67f85391a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:22.910730 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-39b8c5a8-faab-4244-84ed-0db67f85391a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:22.910887 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-39b8c5a8-faab-4244-84ed-0db67f85391a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:22.911503 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-39b8c5a8-faab-4244-84ed-0db67f85391a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:22.911949 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-39b8c5a8-faab-4244-84ed-0db67f85391a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:22.912393 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-39b8c5a8-faab-4244-84ed-0db67f85391a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:23.058487 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-39b8c5a8-faab-4244-84ed-0db67f85391a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:43:23.076314 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-39b8c5a8-faab-4244-84ed-0db67f85391a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1319 microversion: 2.1 time: 0.178622 Aug 31 00:43:23.077125 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 535/1046] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:43:22 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:43:24.102087 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-44f6aa94-5d4e-4912-bd5f-c67b038bdf4f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:24.105560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-44f6aa94-5d4e-4912-bd5f-c67b038bdf4f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:24.110583 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-44f6aa94-5d4e-4912-bd5f-c67b038bdf4f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:24.111360 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-44f6aa94-5d4e-4912-bd5f-c67b038bdf4f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:24.112085 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-44f6aa94-5d4e-4912-bd5f-c67b038bdf4f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:24.113024 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-44f6aa94-5d4e-4912-bd5f-c67b038bdf4f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:24.113647 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-44f6aa94-5d4e-4912-bd5f-c67b038bdf4f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:24.114236 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-44f6aa94-5d4e-4912-bd5f-c67b038bdf4f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:24.307667 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-44f6aa94-5d4e-4912-bd5f-c67b038bdf4f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:43:24.316467 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-44f6aa94-5d4e-4912-bd5f-c67b038bdf4f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1319 microversion: 2.1 time: 0.218480 Aug 31 00:43:24.329327 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 512/1047] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:43:24 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:43:25.340094 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-e2e98c2e-c98a-48e2-93f8-fc2b19b76e2f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:25.344097 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-e2e98c2e-c98a-48e2-93f8-fc2b19b76e2f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:25.344097 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=2 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:25.350510 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e2e98c2e-c98a-48e2-93f8-fc2b19b76e2f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:25.351012 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e2e98c2e-c98a-48e2-93f8-fc2b19b76e2f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:25.351456 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e2e98c2e-c98a-48e2-93f8-fc2b19b76e2f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:25.352264 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e2e98c2e-c98a-48e2-93f8-fc2b19b76e2f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:25.352784 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e2e98c2e-c98a-48e2-93f8-fc2b19b76e2f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:25.353446 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e2e98c2e-c98a-48e2-93f8-fc2b19b76e2f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:25.516288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-e2e98c2e-c98a-48e2-93f8-fc2b19b76e2f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:43:25.524515 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-e2e98c2e-c98a-48e2-93f8-fc2b19b76e2f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1319 microversion: 2.1 time: 0.188763 Aug 31 00:43:25.525158 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 536/1048] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:43:25 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:43:26.147450 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-7d5a1804-dadc-4a25-8e39-2ad02106eeb5 req-5229608d-bc86-4a75-a494-6f28a80ead0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cebf9a2d-edf8-47d6-b21f-0d46098c892d", "name": "network-vif-plugged", "status": "completed", "tag": "61a0644d-28a8-4474-8196-ce23254712ab"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:43:26.156589 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:26.157817 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=8 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:26.162406 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-7d5a1804-dadc-4a25-8e39-2ad02106eeb5 req-5229608d-bc86-4a75-a494-6f28a80ead0d service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:26.162967 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-7d5a1804-dadc-4a25-8e39-2ad02106eeb5 req-5229608d-bc86-4a75-a494-6f28a80ead0d service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:26.163704 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-7d5a1804-dadc-4a25-8e39-2ad02106eeb5 req-5229608d-bc86-4a75-a494-6f28a80ead0d service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:26.186998 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-7d5a1804-dadc-4a25-8e39-2ad02106eeb5 req-5229608d-bc86-4a75-a494-6f28a80ead0d service nova] Creating event network-vif-plugged:61a0644d-28a8-4474-8196-ce23254712ab for instance cebf9a2d-edf8-47d6-b21f-0d46098c892d on hv-cinder-85221 Aug 31 00:43:26.192599 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-7d5a1804-dadc-4a25-8e39-2ad02106eeb5 req-5229608d-bc86-4a75-a494-6f28a80ead0d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049615 Aug 31 00:43:26.193758 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 513/1049] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:43:26.546165 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0559e7ad-d653-444e-a230-c88a49953ce8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:26.546779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-0559e7ad-d653-444e-a230-c88a49953ce8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:26.558139 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0559e7ad-d653-444e-a230-c88a49953ce8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:26.558652 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0559e7ad-d653-444e-a230-c88a49953ce8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:26.559054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0559e7ad-d653-444e-a230-c88a49953ce8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:26.560896 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0559e7ad-d653-444e-a230-c88a49953ce8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:26.561462 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0559e7ad-d653-444e-a230-c88a49953ce8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:26.562022 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0559e7ad-d653-444e-a230-c88a49953ce8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:26.753653 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-0559e7ad-d653-444e-a230-c88a49953ce8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:43:26.762697 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-0559e7ad-d653-444e-a230-c88a49953ce8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1319 microversion: 2.1 time: 0.220688 Aug 31 00:43:26.767985 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 537/1050] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:43:26 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:43:27.790788 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-3c12ec1b-98af-417b-9bef-34d724d4968b tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:27.793820 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-3c12ec1b-98af-417b-9bef-34d724d4968b tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:27.809746 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3c12ec1b-98af-417b-9bef-34d724d4968b tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:27.811207 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3c12ec1b-98af-417b-9bef-34d724d4968b tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:27.812462 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3c12ec1b-98af-417b-9bef-34d724d4968b tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:27.814588 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3c12ec1b-98af-417b-9bef-34d724d4968b tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:27.815560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3c12ec1b-98af-417b-9bef-34d724d4968b tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:27.816693 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3c12ec1b-98af-417b-9bef-34d724d4968b tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:27.986929 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-3c12ec1b-98af-417b-9bef-34d724d4968b tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:43:27.996199 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-3c12ec1b-98af-417b-9bef-34d724d4968b tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1319 microversion: 2.1 time: 0.213645 Aug 31 00:43:27.997196 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 514/1051] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:43:27 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:43:29.018210 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6be5af21-470d-47ab-a701-db6133065434 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:43:29.018859 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6be5af21-470d-47ab-a701-db6133065434 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:29.025500 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6be5af21-470d-47ab-a701-db6133065434 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:29.038702 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6be5af21-470d-47ab-a701-db6133065434 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:29.038702 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6be5af21-470d-47ab-a701-db6133065434 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:29.038702 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6be5af21-470d-47ab-a701-db6133065434 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:29.038702 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6be5af21-470d-47ab-a701-db6133065434 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:29.039123 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6be5af21-470d-47ab-a701-db6133065434 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:29.220797 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6be5af21-470d-47ab-a701-db6133065434 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:43:29.228786 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6be5af21-470d-47ab-a701-db6133065434 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1507 microversion: 2.1 time: 0.214509 Aug 31 00:43:29.229358 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 538/1052] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:43:29 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1507 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:43:58.974967 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-8ac45bc4-695a-47af-a4ad-76d10f919a20 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1ddfb91-e62e-4229-b27f-4a931a78ae96", "device": "/dev/sdb"}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:43:58.977811 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-8ac45bc4-695a-47af-a4ad-76d10f919a20 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:43:58.980346 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:58.982310 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=30 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:58.989196 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ac45bc4-695a-47af-a4ad-76d10f919a20 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:58.989690 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ac45bc4-695a-47af-a4ad-76d10f919a20 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:58.990126 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ac45bc4-695a-47af-a4ad-76d10f919a20 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:43:58.991127 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ac45bc4-695a-47af-a4ad-76d10f919a20 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:43:58.991945 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ac45bc4-695a-47af-a4ad-76d10f919a20 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:43:58.992401 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8ac45bc4-695a-47af-a4ad-76d10f919a20 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:00.164419 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-8ac45bc4-695a-47af-a4ad-76d10f919a20 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "POST /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.193136 Aug 31 00:44:00.165147 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 515/1053] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 00:43:58 2022] POST /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d/os-volume_attachments => generated 194 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:44:21.990850 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:21.992033 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-27cd1a14-5528-44e0-882a-9adfd2b4ca3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:21.992808 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:21.992985 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-27cd1a14-5528-44e0-882a-9adfd2b4ca3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:21.997193 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-57c4b514-7d6f-4fe6-bbb1-518594a6434d req-ab9f4997-b502-4cf2-9114-f8590584abe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "238e7167-528f-4320-99b2-344f8683cde6", "tag": "d6e8579c-bd80-41e5-85c3-d0906fe6933e"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:44:21.998924 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=18 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:21.999920 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=42 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:22.002179 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-27cd1a14-5528-44e0-882a-9adfd2b4ca3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:22.005669 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-27cd1a14-5528-44e0-882a-9adfd2b4ca3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:22.005669 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-27cd1a14-5528-44e0-882a-9adfd2b4ca3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:22.005669 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-27cd1a14-5528-44e0-882a-9adfd2b4ca3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:22.005669 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-27cd1a14-5528-44e0-882a-9adfd2b4ca3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:22.006092 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-27cd1a14-5528-44e0-882a-9adfd2b4ca3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:22.009488 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-57c4b514-7d6f-4fe6-bbb1-518594a6434d req-ab9f4997-b502-4cf2-9114-f8590584abe4 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:22.010058 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-57c4b514-7d6f-4fe6-bbb1-518594a6434d req-ab9f4997-b502-4cf2-9114-f8590584abe4 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:22.010848 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-57c4b514-7d6f-4fe6-bbb1-518594a6434d req-ab9f4997-b502-4cf2-9114-f8590584abe4 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:22.024983 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-57c4b514-7d6f-4fe6-bbb1-518594a6434d req-ab9f4997-b502-4cf2-9114-f8590584abe4 service nova] Creating event network-changed:d6e8579c-bd80-41e5-85c3-d0906fe6933e for instance 238e7167-528f-4320-99b2-344f8683cde6 on hv-cinder-85221 Aug 31 00:44:22.030694 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-57c4b514-7d6f-4fe6-bbb1-518594a6434d req-ab9f4997-b502-4cf2-9114-f8590584abe4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040938 Aug 31 00:44:22.031511 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 516/1054] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:44:22.041879 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-27cd1a14-5528-44e0-882a-9adfd2b4ca3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Going to try to terminate instance {{(pid=128049) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:44:22.318632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-27cd1a14-5528-44e0-882a-9adfd2b4ca3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "DELETE /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 204 len: 0 microversion: 2.1 time: 0.330878 Aug 31 00:44:22.320542 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 539/1055] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:44:21 2022] DELETE /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:44:22.335552 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-2c9af466-b0e5-48ba-bc27-e7e5052728e2 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:22.336224 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-2c9af466-b0e5-48ba-bc27-e7e5052728e2 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:22.343756 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2c9af466-b0e5-48ba-bc27-e7e5052728e2 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:22.344234 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2c9af466-b0e5-48ba-bc27-e7e5052728e2 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:22.344739 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2c9af466-b0e5-48ba-bc27-e7e5052728e2 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:22.345457 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2c9af466-b0e5-48ba-bc27-e7e5052728e2 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:22.345924 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2c9af466-b0e5-48ba-bc27-e7e5052728e2 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:22.347039 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2c9af466-b0e5-48ba-bc27-e7e5052728e2 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:22.512462 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-2c9af466-b0e5-48ba-bc27-e7e5052728e2 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:22.521578 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-2c9af466-b0e5-48ba-bc27-e7e5052728e2 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1578 microversion: 2.1 time: 0.195057 Aug 31 00:44:22.522147 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 517/1056] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:22 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1578 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:23.545900 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-20059011-812b-4577-86e1-9d199b891aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:23.546650 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-20059011-812b-4577-86e1-9d199b891aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:23.553441 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-20059011-812b-4577-86e1-9d199b891aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:23.554098 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-20059011-812b-4577-86e1-9d199b891aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:23.554771 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-20059011-812b-4577-86e1-9d199b891aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:23.555521 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-20059011-812b-4577-86e1-9d199b891aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:23.556016 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-20059011-812b-4577-86e1-9d199b891aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:23.556510 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-20059011-812b-4577-86e1-9d199b891aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:23.699521 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-20059011-812b-4577-86e1-9d199b891aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:23.707768 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-20059011-812b-4577-86e1-9d199b891aa0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1578 microversion: 2.1 time: 0.166214 Aug 31 00:44:23.708362 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 540/1057] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:23 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:24.730994 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-fe64f728-2f28-433d-94d1-17782d093e6e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:24.731716 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-fe64f728-2f28-433d-94d1-17782d093e6e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:24.738040 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fe64f728-2f28-433d-94d1-17782d093e6e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:24.738517 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fe64f728-2f28-433d-94d1-17782d093e6e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:24.738948 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fe64f728-2f28-433d-94d1-17782d093e6e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:24.739641 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fe64f728-2f28-433d-94d1-17782d093e6e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:24.740093 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fe64f728-2f28-433d-94d1-17782d093e6e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:24.740549 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fe64f728-2f28-433d-94d1-17782d093e6e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:24.901214 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fe64f728-2f28-433d-94d1-17782d093e6e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:24.909258 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-fe64f728-2f28-433d-94d1-17782d093e6e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1578 microversion: 2.1 time: 0.182241 Aug 31 00:44:24.909815 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 518/1058] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:24 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1578 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:25.930360 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-cc50af74-67b2-44a7-a633-4a15d0dd666f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:25.930995 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-cc50af74-67b2-44a7-a633-4a15d0dd666f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:25.937586 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cc50af74-67b2-44a7-a633-4a15d0dd666f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:25.938062 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cc50af74-67b2-44a7-a633-4a15d0dd666f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:25.938490 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cc50af74-67b2-44a7-a633-4a15d0dd666f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:25.939202 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cc50af74-67b2-44a7-a633-4a15d0dd666f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:25.939650 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cc50af74-67b2-44a7-a633-4a15d0dd666f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:25.940068 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cc50af74-67b2-44a7-a633-4a15d0dd666f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:26.078684 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-cc50af74-67b2-44a7-a633-4a15d0dd666f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:26.088553 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-cc50af74-67b2-44a7-a633-4a15d0dd666f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1578 microversion: 2.1 time: 0.162435 Aug 31 00:44:26.089121 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 541/1059] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:25 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:27.077990 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-891be373-61cc-46eb-8d64-01b340738aac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-348880867", "imageRef": "12947ed8-8ca9-442d-9224-509e79a198e7", "flavorRef": "452"}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:44:27.110287 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-72cad1ea-29b9-4d5d-9939-33a27f13438f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:27.110842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-72cad1ea-29b9-4d5d-9939-33a27f13438f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:27.118592 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-72cad1ea-29b9-4d5d-9939-33a27f13438f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:27.118928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-72cad1ea-29b9-4d5d-9939-33a27f13438f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:27.119302 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-72cad1ea-29b9-4d5d-9939-33a27f13438f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:27.120091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-72cad1ea-29b9-4d5d-9939-33a27f13438f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:27.120598 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-72cad1ea-29b9-4d5d-9939-33a27f13438f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:27.121016 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-72cad1ea-29b9-4d5d-9939-33a27f13438f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:27.137665 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.network.neutron [None req-891be373-61cc-46eb-8d64-01b340738aac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] validate_networks() for None {{(pid=128048) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:44:27.263702 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-72cad1ea-29b9-4d5d-9939-33a27f13438f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:27.272190 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-72cad1ea-29b9-4d5d-9939-33a27f13438f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1578 microversion: 2.1 time: 0.165915 Aug 31 00:44:27.273809 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 542/1060] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:27 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:44:27.971378 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-891be373-61cc-46eb-8d64-01b340738aac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Flavor limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:44:27.971799 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-891be373-61cc-46eb-8d64-01b340738aac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Image limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:44:27.972271 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-891be373-61cc-46eb-8d64-01b340738aac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Flavor pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:44:27.972938 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-891be373-61cc-46eb-8d64-01b340738aac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Image pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:44:27.973349 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-891be373-61cc-46eb-8d64-01b340738aac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:44:27.983877 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-891be373-61cc-46eb-8d64-01b340738aac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:27.984413 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-891be373-61cc-46eb-8d64-01b340738aac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:27.985099 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-891be373-61cc-46eb-8d64-01b340738aac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:27.985753 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-891be373-61cc-46eb-8d64-01b340738aac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:27.986533 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-891be373-61cc-46eb-8d64-01b340738aac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:27.987420 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-891be373-61cc-46eb-8d64-01b340738aac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:28.017501 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-891be373-61cc-46eb-8d64-01b340738aac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Getting quotas for project f4aa358ff1064f05968fff832ea588ee. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:44:28.023108 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-891be373-61cc-46eb-8d64-01b340738aac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Getting quotas for user 282cf38c59c4445ca943236cd9a08ec6 and project f4aa358ff1064f05968fff832ea588ee. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:44:28.036258 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-891be373-61cc-46eb-8d64-01b340738aac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Going to run 1 instances... {{(pid=128048) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:44:28.040341 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-891be373-61cc-46eb-8d64-01b340738aac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12947ed8-8ca9-442d-9224-509e79a198e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128048) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:44:28.171164 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-891be373-61cc-46eb-8d64-01b340738aac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.096976 Aug 31 00:44:28.172739 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 519/1061] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:44:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:44:28.183573 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0335d03c-5103-4327-92b9-0a7a3ac6c79e tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:28.184217 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-0335d03c-5103-4327-92b9-0a7a3ac6c79e tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:28.245216 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-0335d03c-5103-4327-92b9-0a7a3ac6c79e tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:28.264915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-0335d03c-5103-4327-92b9-0a7a3ac6c79e tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1214 microversion: 2.1 time: 0.073796 Aug 31 00:44:28.264915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 543/1062] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:28 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:28.297711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7f989155-8a03-4cd7-9050-39c1ece217f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:28.298391 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7f989155-8a03-4cd7-9050-39c1ece217f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:28.306426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f989155-8a03-4cd7-9050-39c1ece217f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:28.307197 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f989155-8a03-4cd7-9050-39c1ece217f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:28.307812 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f989155-8a03-4cd7-9050-39c1ece217f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:28.308562 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f989155-8a03-4cd7-9050-39c1ece217f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:28.309200 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f989155-8a03-4cd7-9050-39c1ece217f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:28.309932 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f989155-8a03-4cd7-9050-39c1ece217f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:28.430249 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-7f989155-8a03-4cd7-9050-39c1ece217f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:28.435734 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-7f989155-8a03-4cd7-9050-39c1ece217f4 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1391 microversion: 2.1 time: 0.143916 Aug 31 00:44:28.436310 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 520/1063] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:28 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1391 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:28.438953 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-9943c2d0-5537-4bcb-aa36-dfdd28c37d1a req-681e9797-6207-4e72-b898-43bd9510851e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238e7167-528f-4320-99b2-344f8683cde6", "name": "network-vif-deleted", "tag": "d6e8579c-bd80-41e5-85c3-d0906fe6933e"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:44:28.451241 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-9943c2d0-5537-4bcb-aa36-dfdd28c37d1a req-681e9797-6207-4e72-b898-43bd9510851e service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:28.453043 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-9943c2d0-5537-4bcb-aa36-dfdd28c37d1a req-681e9797-6207-4e72-b898-43bd9510851e service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:28.453043 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-9943c2d0-5537-4bcb-aa36-dfdd28c37d1a req-681e9797-6207-4e72-b898-43bd9510851e service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:28.464120 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-9943c2d0-5537-4bcb-aa36-dfdd28c37d1a req-681e9797-6207-4e72-b898-43bd9510851e service nova] Creating event network-vif-deleted:d6e8579c-bd80-41e5-85c3-d0906fe6933e for instance 238e7167-528f-4320-99b2-344f8683cde6 on hv-cinder-85221 Aug 31 00:44:28.469174 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-9943c2d0-5537-4bcb-aa36-dfdd28c37d1a req-681e9797-6207-4e72-b898-43bd9510851e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034126 Aug 31 00:44:28.469800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 544/1064] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:44:29.277091 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f34dc4ee-c30e-487c-b327-d524f13a9179 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:29.278074 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-f34dc4ee-c30e-487c-b327-d524f13a9179 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:29.336065 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f34dc4ee-c30e-487c-b327-d524f13a9179 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:29.346937 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f34dc4ee-c30e-487c-b327-d524f13a9179 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1214 microversion: 2.1 time: 0.074053 Aug 31 00:44:29.357653 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 521/1065] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:29 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:29.458964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-25c7ab64-a910-416a-881e-ef175cba660b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:29.460894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-25c7ab64-a910-416a-881e-ef175cba660b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:29.468826 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-25c7ab64-a910-416a-881e-ef175cba660b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:29.469537 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-25c7ab64-a910-416a-881e-ef175cba660b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:29.476090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-25c7ab64-a910-416a-881e-ef175cba660b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:29.476090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-25c7ab64-a910-416a-881e-ef175cba660b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:29.476090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-25c7ab64-a910-416a-881e-ef175cba660b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:29.476090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-25c7ab64-a910-416a-881e-ef175cba660b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:29.504652 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-25c7ab64-a910-416a-881e-ef175cba660b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:29.505132 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-25c7ab64-a910-416a-881e-ef175cba660b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:29.505571 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-25c7ab64-a910-416a-881e-ef175cba660b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:29.510502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-25c7ab64-a910-416a-881e-ef175cba660b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lazy-loading 'fault' on Instance uuid 238e7167-528f-4320-99b2-344f8683cde6 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:44:29.549472 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-25c7ab64-a910-416a-881e-ef175cba660b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:29.558144 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-25c7ab64-a910-416a-881e-ef175cba660b tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1230 microversion: 2.1 time: 0.104104 Aug 31 00:44:29.558711 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 545/1066] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:29 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:30.369119 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9e57f390-1e60-40dc-8f46-903121359833 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:30.369751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9e57f390-1e60-40dc-8f46-903121359833 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:30.376955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9e57f390-1e60-40dc-8f46-903121359833 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:30.377493 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9e57f390-1e60-40dc-8f46-903121359833 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:30.377931 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9e57f390-1e60-40dc-8f46-903121359833 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:30.378739 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9e57f390-1e60-40dc-8f46-903121359833 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:30.379201 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9e57f390-1e60-40dc-8f46-903121359833 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:30.379625 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9e57f390-1e60-40dc-8f46-903121359833 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:30.444520 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-9e57f390-1e60-40dc-8f46-903121359833 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:30.452405 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9e57f390-1e60-40dc-8f46-903121359833 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1218 microversion: 2.1 time: 0.087635 Aug 31 00:44:30.452962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 522/1067] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:30 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:30.580680 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-153892c7-3fe0-488a-ae5e-eddca13f312f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:30.581323 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-153892c7-3fe0-488a-ae5e-eddca13f312f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:30.588484 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-153892c7-3fe0-488a-ae5e-eddca13f312f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:30.588959 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-153892c7-3fe0-488a-ae5e-eddca13f312f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:30.589386 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-153892c7-3fe0-488a-ae5e-eddca13f312f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:30.590069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-153892c7-3fe0-488a-ae5e-eddca13f312f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:30.590513 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-153892c7-3fe0-488a-ae5e-eddca13f312f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:30.590926 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-153892c7-3fe0-488a-ae5e-eddca13f312f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:30.625604 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-153892c7-3fe0-488a-ae5e-eddca13f312f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:30.626084 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-153892c7-3fe0-488a-ae5e-eddca13f312f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:30.626516 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-153892c7-3fe0-488a-ae5e-eddca13f312f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:30.626961 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-153892c7-3fe0-488a-ae5e-eddca13f312f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lazy-loading 'fault' on Instance uuid 238e7167-528f-4320-99b2-344f8683cde6 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:44:30.670070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-153892c7-3fe0-488a-ae5e-eddca13f312f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:30.677819 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-153892c7-3fe0-488a-ae5e-eddca13f312f tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1230 microversion: 2.1 time: 0.101082 Aug 31 00:44:30.678385 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 546/1068] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:30 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:44:31.473958 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-092e429c-2b4a-4b85-9378-521c476eb845 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:31.474566 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-092e429c-2b4a-4b85-9378-521c476eb845 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:31.481684 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-092e429c-2b4a-4b85-9378-521c476eb845 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:31.482165 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-092e429c-2b4a-4b85-9378-521c476eb845 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:31.482597 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-092e429c-2b4a-4b85-9378-521c476eb845 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:31.483335 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-092e429c-2b4a-4b85-9378-521c476eb845 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:31.483910 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-092e429c-2b4a-4b85-9378-521c476eb845 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:31.484344 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-092e429c-2b4a-4b85-9378-521c476eb845 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:31.546318 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-092e429c-2b4a-4b85-9378-521c476eb845 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:31.554700 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-092e429c-2b4a-4b85-9378-521c476eb845 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1218 microversion: 2.1 time: 0.083878 Aug 31 00:44:31.555403 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 523/1069] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:31 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:31.698791 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f50c0d80-cf04-4770-91d8-5a7206799607 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:31.699420 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f50c0d80-cf04-4770-91d8-5a7206799607 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:31.706116 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f50c0d80-cf04-4770-91d8-5a7206799607 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:31.706817 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f50c0d80-cf04-4770-91d8-5a7206799607 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:31.707257 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f50c0d80-cf04-4770-91d8-5a7206799607 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:31.707960 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f50c0d80-cf04-4770-91d8-5a7206799607 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:31.708435 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f50c0d80-cf04-4770-91d8-5a7206799607 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:31.708859 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f50c0d80-cf04-4770-91d8-5a7206799607 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:31.744976 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f50c0d80-cf04-4770-91d8-5a7206799607 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:31.745458 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f50c0d80-cf04-4770-91d8-5a7206799607 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:31.745897 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f50c0d80-cf04-4770-91d8-5a7206799607 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:31.746344 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-f50c0d80-cf04-4770-91d8-5a7206799607 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lazy-loading 'fault' on Instance uuid 238e7167-528f-4320-99b2-344f8683cde6 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:44:31.791379 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f50c0d80-cf04-4770-91d8-5a7206799607 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:31.799504 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f50c0d80-cf04-4770-91d8-5a7206799607 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1230 microversion: 2.1 time: 0.104728 Aug 31 00:44:31.800107 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 547/1070] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:31 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:32.575501 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-b96c19d4-6b0d-4ac1-8594-c9b11fc7c46d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:32.576048 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-b96c19d4-6b0d-4ac1-8594-c9b11fc7c46d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:32.582570 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b96c19d4-6b0d-4ac1-8594-c9b11fc7c46d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:32.583048 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b96c19d4-6b0d-4ac1-8594-c9b11fc7c46d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:32.583472 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b96c19d4-6b0d-4ac1-8594-c9b11fc7c46d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:32.584148 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b96c19d4-6b0d-4ac1-8594-c9b11fc7c46d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:32.584616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b96c19d4-6b0d-4ac1-8594-c9b11fc7c46d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:32.585538 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-b96c19d4-6b0d-4ac1-8594-c9b11fc7c46d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:32.648555 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-b96c19d4-6b0d-4ac1-8594-c9b11fc7c46d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:32.656578 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-b96c19d4-6b0d-4ac1-8594-c9b11fc7c46d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1210 microversion: 2.1 time: 0.085064 Aug 31 00:44:32.657148 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 524/1071] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:32 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:32.820884 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d65b5155-d3d9-433f-ba55-4532e043f611 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:32.821480 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d65b5155-d3d9-433f-ba55-4532e043f611 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:32.828926 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d65b5155-d3d9-433f-ba55-4532e043f611 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:32.829834 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d65b5155-d3d9-433f-ba55-4532e043f611 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:32.830497 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d65b5155-d3d9-433f-ba55-4532e043f611 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:32.831595 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d65b5155-d3d9-433f-ba55-4532e043f611 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:32.832454 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d65b5155-d3d9-433f-ba55-4532e043f611 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:32.832872 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d65b5155-d3d9-433f-ba55-4532e043f611 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:32.867641 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d65b5155-d3d9-433f-ba55-4532e043f611 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:32.868219 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d65b5155-d3d9-433f-ba55-4532e043f611 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:32.868670 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d65b5155-d3d9-433f-ba55-4532e043f611 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:32.869106 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-d65b5155-d3d9-433f-ba55-4532e043f611 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lazy-loading 'fault' on Instance uuid 238e7167-528f-4320-99b2-344f8683cde6 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:44:32.911478 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d65b5155-d3d9-433f-ba55-4532e043f611 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:32.920599 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d65b5155-d3d9-433f-ba55-4532e043f611 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1230 microversion: 2.1 time: 0.103746 Aug 31 00:44:32.921208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 548/1072] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:32 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:33.681671 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-28f9a223-ed0c-45b2-bc38-7fa918428d05 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:33.682284 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-28f9a223-ed0c-45b2-bc38-7fa918428d05 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:33.689260 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-28f9a223-ed0c-45b2-bc38-7fa918428d05 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:33.689739 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-28f9a223-ed0c-45b2-bc38-7fa918428d05 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:33.690164 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-28f9a223-ed0c-45b2-bc38-7fa918428d05 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:33.690969 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-28f9a223-ed0c-45b2-bc38-7fa918428d05 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:33.691463 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-28f9a223-ed0c-45b2-bc38-7fa918428d05 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:33.691848 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-28f9a223-ed0c-45b2-bc38-7fa918428d05 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:33.756496 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-28f9a223-ed0c-45b2-bc38-7fa918428d05 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:33.764583 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-28f9a223-ed0c-45b2-bc38-7fa918428d05 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1266 microversion: 2.1 time: 0.087483 Aug 31 00:44:33.765153 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 525/1073] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:33 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:33.942221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-cfa66a04-d1dc-4518-8c3d-43a6f6d50d7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:33.942837 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-cfa66a04-d1dc-4518-8c3d-43a6f6d50d7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:33.950057 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cfa66a04-d1dc-4518-8c3d-43a6f6d50d7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:33.950539 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cfa66a04-d1dc-4518-8c3d-43a6f6d50d7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:33.951005 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cfa66a04-d1dc-4518-8c3d-43a6f6d50d7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:33.951693 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cfa66a04-d1dc-4518-8c3d-43a6f6d50d7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:33.952143 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cfa66a04-d1dc-4518-8c3d-43a6f6d50d7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:33.952601 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cfa66a04-d1dc-4518-8c3d-43a6f6d50d7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:33.984649 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cfa66a04-d1dc-4518-8c3d-43a6f6d50d7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:33.985123 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cfa66a04-d1dc-4518-8c3d-43a6f6d50d7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:33.985554 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cfa66a04-d1dc-4518-8c3d-43a6f6d50d7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:33.985997 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-cfa66a04-d1dc-4518-8c3d-43a6f6d50d7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lazy-loading 'fault' on Instance uuid 238e7167-528f-4320-99b2-344f8683cde6 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:44:34.028120 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-cfa66a04-d1dc-4518-8c3d-43a6f6d50d7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:34.035774 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-cfa66a04-d1dc-4518-8c3d-43a6f6d50d7e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 200 len: 1230 microversion: 2.1 time: 0.097694 Aug 31 00:44:34.036351 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 549/1074] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:33 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:34.784770 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ebf43444-f243-447b-8d27-3d34d236fa0f tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:34.785377 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ebf43444-f243-447b-8d27-3d34d236fa0f tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:34.792585 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ebf43444-f243-447b-8d27-3d34d236fa0f tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:34.793042 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ebf43444-f243-447b-8d27-3d34d236fa0f tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:34.793759 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ebf43444-f243-447b-8d27-3d34d236fa0f tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:34.794417 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ebf43444-f243-447b-8d27-3d34d236fa0f tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:34.794878 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ebf43444-f243-447b-8d27-3d34d236fa0f tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:34.795297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ebf43444-f243-447b-8d27-3d34d236fa0f tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:34.857259 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ebf43444-f243-447b-8d27-3d34d236fa0f tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:34.864808 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ebf43444-f243-447b-8d27-3d34d236fa0f tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1266 microversion: 2.1 time: 0.083798 Aug 31 00:44:34.865362 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 526/1075] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:34 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:35.057114 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f3d6e071-7124-4ab7-8292-63a12176e0f6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:35.057646 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f3d6e071-7124-4ab7-8292-63a12176e0f6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 238e7167-528f-4320-99b2-344f8683cde6] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:35.063917 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f3d6e071-7124-4ab7-8292-63a12176e0f6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:35.064605 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f3d6e071-7124-4ab7-8292-63a12176e0f6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:35.065039 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f3d6e071-7124-4ab7-8292-63a12176e0f6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:35.065726 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f3d6e071-7124-4ab7-8292-63a12176e0f6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:35.066168 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f3d6e071-7124-4ab7-8292-63a12176e0f6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:35.066579 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f3d6e071-7124-4ab7-8292-63a12176e0f6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:35.080800 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-f3d6e071-7124-4ab7-8292-63a12176e0f6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] HTTP exception thrown: Instance 238e7167-528f-4320-99b2-344f8683cde6 could not be found. Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f3d6e071-7124-4ab7-8292-63a12176e0f6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Request method failure captured: Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 HTTP/1.1 Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqz6bcJzptONpYzZ--ZxIFkUzMrDN78zWIuu9D1e8slegZKQFDIUR23b9Wk_yos9bDDSwM5IEKLs0-WFJ5UNXiEFrjXcmVGtPeg__15wQjQd90xqU_iIDATE3bR0sdytfyIwr2Fuu6kys33v7DJjsesMlqVcEzLokOVGJK-DL_Q49Ew Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: ebe5283d88b44f8b824c7bbca56b3473 Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-TestVolumeBootPattern-1930465684 Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:44:35.082430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:44:35.084104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:44:35.084104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-TestVolumeBootPattern-1930465684 Aug 31 00:44:35.084104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: ebe5283d88b44f8b824c7bbca56b3473 Aug 31 00:44:35.084104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-TestVolumeBootPattern-1930465684 Aug 31 00:44:35.084104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-TestVolumeBootPattern-1930465684-project Aug 31 00:44:35.084104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:44:35.084104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:44:35.084104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 022c4688d9ce4df9a99ae5fa84e1d871 Aug 31 00:44:35.084104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-TestVolumeBootPattern-1930465684-project Aug 31 00:44:35.084104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:44:35.084104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance 238e7167-528f-4320-99b2-344f8683cde6 could not be found. Aug 31 00:44:35.084104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': '238e7167-528f-4320-99b2-344f8683cde6'} Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 238e7167-528f-4320-99b2-344f8683cde6 could not be found. Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:44:35.085090 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:44:35.086406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:44:35.086406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:44:35.086406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:44:35.086406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:44:35.086406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:44:35.086406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:44:35.086406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:44:35.086406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 238e7167-528f-4320-99b2-344f8683cde6 could not be found. Aug 31 00:44:35.086406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:44:35.086406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:44:35.086406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:44:35.086406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:44:35.086406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:44:35.086406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:44:35.086406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:44:35.086406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:44:35.086406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 238e7167-528f-4320-99b2-344f8683cde6 could not be found. Aug 31 00:44:35.086406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:44:35.088201 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f3d6e071-7124-4ab7-8292-63a12176e0f6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Returning 404 to user: Instance 238e7167-528f-4320-99b2-344f8683cde6 could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:44:35.088201 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f3d6e071-7124-4ab7-8292-63a12176e0f6 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6" status: 404 len: 111 microversion: 2.1 time: 0.031111 Aug 31 00:44:35.088201 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 550/1076] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:35 2022] GET /compute/v2.1/servers/238e7167-528f-4320-99b2-344f8683cde6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:44:35.885949 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-cdae1f72-b796-48ef-8472-0ba7f3d09a46 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:35.886484 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-cdae1f72-b796-48ef-8472-0ba7f3d09a46 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:35.892621 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cdae1f72-b796-48ef-8472-0ba7f3d09a46 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:35.893106 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cdae1f72-b796-48ef-8472-0ba7f3d09a46 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:35.893540 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cdae1f72-b796-48ef-8472-0ba7f3d09a46 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:35.894232 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cdae1f72-b796-48ef-8472-0ba7f3d09a46 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:35.894679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cdae1f72-b796-48ef-8472-0ba7f3d09a46 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:35.895106 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cdae1f72-b796-48ef-8472-0ba7f3d09a46 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:35.958383 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-cdae1f72-b796-48ef-8472-0ba7f3d09a46 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:35.966149 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-cdae1f72-b796-48ef-8472-0ba7f3d09a46 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1266 microversion: 2.1 time: 0.084566 Aug 31 00:44:35.966728 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 527/1077] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:35 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:36.988281 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-5c07516a-d3b4-487f-822c-9660516a8ba5 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:36.988923 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-5c07516a-d3b4-487f-822c-9660516a8ba5 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:36.996067 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5c07516a-d3b4-487f-822c-9660516a8ba5 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:36.996585 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5c07516a-d3b4-487f-822c-9660516a8ba5 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:36.997025 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5c07516a-d3b4-487f-822c-9660516a8ba5 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:36.997782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5c07516a-d3b4-487f-822c-9660516a8ba5 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:36.998260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5c07516a-d3b4-487f-822c-9660516a8ba5 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:36.998686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5c07516a-d3b4-487f-822c-9660516a8ba5 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:37.063795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-5c07516a-d3b4-487f-822c-9660516a8ba5 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:37.068628 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-5c07516a-d3b4-487f-822c-9660516a8ba5 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1274 microversion: 2.1 time: 0.084339 Aug 31 00:44:37.069196 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 551/1078] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:36 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:38.091273 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d08bfb77-e185-480b-9765-5fc693d1ae23 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:38.091918 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d08bfb77-e185-480b-9765-5fc693d1ae23 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:38.094845 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:38.100932 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d08bfb77-e185-480b-9765-5fc693d1ae23 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:38.101516 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d08bfb77-e185-480b-9765-5fc693d1ae23 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:38.102089 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d08bfb77-e185-480b-9765-5fc693d1ae23 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:38.103137 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d08bfb77-e185-480b-9765-5fc693d1ae23 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:38.103737 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d08bfb77-e185-480b-9765-5fc693d1ae23 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:38.104471 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d08bfb77-e185-480b-9765-5fc693d1ae23 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:38.175481 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d08bfb77-e185-480b-9765-5fc693d1ae23 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:38.183382 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d08bfb77-e185-480b-9765-5fc693d1ae23 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1274 microversion: 2.1 time: 0.097187 Aug 31 00:44:38.183945 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 528/1079] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:38 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:39.204940 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-815840d2-dc3f-4a61-88a1-fb466df8fb60 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:39.205548 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-815840d2-dc3f-4a61-88a1-fb466df8fb60 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:39.208032 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=2 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:39.213382 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-815840d2-dc3f-4a61-88a1-fb466df8fb60 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:39.213916 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-815840d2-dc3f-4a61-88a1-fb466df8fb60 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:39.214324 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-815840d2-dc3f-4a61-88a1-fb466df8fb60 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:39.215009 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-815840d2-dc3f-4a61-88a1-fb466df8fb60 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:39.215463 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-815840d2-dc3f-4a61-88a1-fb466df8fb60 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:39.215883 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-815840d2-dc3f-4a61-88a1-fb466df8fb60 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:39.283822 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-815840d2-dc3f-4a61-88a1-fb466df8fb60 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:39.295155 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-815840d2-dc3f-4a61-88a1-fb466df8fb60 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1272 microversion: 2.1 time: 0.094258 Aug 31 00:44:39.295937 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 552/1080] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:39 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1272 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:40.318321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-2224a972-3fca-4717-bb55-622767d3f09b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:40.318978 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-2224a972-3fca-4717-bb55-622767d3f09b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:40.321801 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=8 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:40.327599 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2224a972-3fca-4717-bb55-622767d3f09b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:40.328317 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2224a972-3fca-4717-bb55-622767d3f09b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:40.328971 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2224a972-3fca-4717-bb55-622767d3f09b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:40.333332 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2224a972-3fca-4717-bb55-622767d3f09b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:40.333332 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2224a972-3fca-4717-bb55-622767d3f09b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:40.333332 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2224a972-3fca-4717-bb55-622767d3f09b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:40.565417 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-2224a972-3fca-4717-bb55-622767d3f09b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:40.574532 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-2224a972-3fca-4717-bb55-622767d3f09b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1314 microversion: 2.1 time: 0.260605 Aug 31 00:44:40.578872 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 529/1081] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:40 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:40.762642 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-2bd06407-7440-4d8e-ac62-6aee41e8c0af req-bcc54e95-d317-4e92-9680-c4355a538e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "920af99b-43ea-46e0-8873-38efab535745", "tag": "14029285-926b-41de-bdc4-a196e9cea3c9"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:44:40.774851 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-2bd06407-7440-4d8e-ac62-6aee41e8c0af req-bcc54e95-d317-4e92-9680-c4355a538e78 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:40.775321 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-2bd06407-7440-4d8e-ac62-6aee41e8c0af req-bcc54e95-d317-4e92-9680-c4355a538e78 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:40.775740 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-2bd06407-7440-4d8e-ac62-6aee41e8c0af req-bcc54e95-d317-4e92-9680-c4355a538e78 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:40.789408 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-2bd06407-7440-4d8e-ac62-6aee41e8c0af req-bcc54e95-d317-4e92-9680-c4355a538e78 service nova] Creating event network-changed:14029285-926b-41de-bdc4-a196e9cea3c9 for instance 920af99b-43ea-46e0-8873-38efab535745 on hv-cinder-85221 Aug 31 00:44:40.795097 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-2bd06407-7440-4d8e-ac62-6aee41e8c0af req-bcc54e95-d317-4e92-9680-c4355a538e78 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038526 Aug 31 00:44:40.795097 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 553/1082] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:44:41.596750 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7f59c7ce-1c4a-4260-b872-2ea681b587f0 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:41.597299 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7f59c7ce-1c4a-4260-b872-2ea681b587f0 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:41.604672 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f59c7ce-1c4a-4260-b872-2ea681b587f0 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:41.605149 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f59c7ce-1c4a-4260-b872-2ea681b587f0 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:41.605578 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f59c7ce-1c4a-4260-b872-2ea681b587f0 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:41.606269 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f59c7ce-1c4a-4260-b872-2ea681b587f0 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:41.606709 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f59c7ce-1c4a-4260-b872-2ea681b587f0 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:41.607127 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f59c7ce-1c4a-4260-b872-2ea681b587f0 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:41.839686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-dab934c7-2df3-4bca-836e-30c05a999ff1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:41.840283 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-dab934c7-2df3-4bca-836e-30c05a999ff1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:41.845002 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-7f59c7ce-1c4a-4260-b872-2ea681b587f0 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:41.846856 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dab934c7-2df3-4bca-836e-30c05a999ff1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:41.847284 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dab934c7-2df3-4bca-836e-30c05a999ff1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:41.847753 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dab934c7-2df3-4bca-836e-30c05a999ff1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:41.848482 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dab934c7-2df3-4bca-836e-30c05a999ff1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:41.848952 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dab934c7-2df3-4bca-836e-30c05a999ff1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:41.849363 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-dab934c7-2df3-4bca-836e-30c05a999ff1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:41.854140 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-7f59c7ce-1c4a-4260-b872-2ea681b587f0 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1314 microversion: 2.1 time: 0.261320 Aug 31 00:44:41.855040 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 530/1083] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:41 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:41.878243 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-dab934c7-2df3-4bca-836e-30c05a999ff1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Going to try to terminate instance {{(pid=128049) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:44:41.894025 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:42.213599 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-dab934c7-2df3-4bca-836e-30c05a999ff1 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "DELETE /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 204 len: 0 microversion: 2.1 time: 0.379075 Aug 31 00:44:42.214186 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 554/1084] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:44:41 2022] DELETE /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:44:42.222900 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-8286411e-a88f-439a-b775-486c2db95db9 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:42.223506 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-8286411e-a88f-439a-b775-486c2db95db9 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:42.229831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8286411e-a88f-439a-b775-486c2db95db9 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:42.230317 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8286411e-a88f-439a-b775-486c2db95db9 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:42.230749 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8286411e-a88f-439a-b775-486c2db95db9 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:42.231451 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8286411e-a88f-439a-b775-486c2db95db9 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:42.231896 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8286411e-a88f-439a-b775-486c2db95db9 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:42.232313 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-8286411e-a88f-439a-b775-486c2db95db9 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:42.396851 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-8286411e-a88f-439a-b775-486c2db95db9 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:42.405837 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-8286411e-a88f-439a-b775-486c2db95db9 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1579 microversion: 2.1 time: 0.186728 Aug 31 00:44:42.406421 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 531/1085] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:42 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1579 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:42.816401 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-5018560e-05f4-4db3-a35d-c7e59c91f1a1 req-97c64c46-bdbf-4ec3-8c76-6eee2e879784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747", "tag": "d40a5de5-de00-4fca-9d0f-1539d5f4fc04"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:44:42.826656 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-5018560e-05f4-4db3-a35d-c7e59c91f1a1 req-97c64c46-bdbf-4ec3-8c76-6eee2e879784 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:42.827124 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-5018560e-05f4-4db3-a35d-c7e59c91f1a1 req-97c64c46-bdbf-4ec3-8c76-6eee2e879784 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:42.827614 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-5018560e-05f4-4db3-a35d-c7e59c91f1a1 req-97c64c46-bdbf-4ec3-8c76-6eee2e879784 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:42.839616 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-5018560e-05f4-4db3-a35d-c7e59c91f1a1 req-97c64c46-bdbf-4ec3-8c76-6eee2e879784 service nova] Creating event network-changed:d40a5de5-de00-4fca-9d0f-1539d5f4fc04 for instance 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 on hv-cinder-85221 Aug 31 00:44:42.845272 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-5018560e-05f4-4db3-a35d-c7e59c91f1a1 req-97c64c46-bdbf-4ec3-8c76-6eee2e879784 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036121 Aug 31 00:44:42.846639 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 555/1086] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:44:42.876778 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-0035a8a9-38af-48c9-b08a-0ec90e741b93 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:42.877359 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-0035a8a9-38af-48c9-b08a-0ec90e741b93 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:42.884312 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0035a8a9-38af-48c9-b08a-0ec90e741b93 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:42.884883 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0035a8a9-38af-48c9-b08a-0ec90e741b93 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:42.885733 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0035a8a9-38af-48c9-b08a-0ec90e741b93 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:42.887040 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0035a8a9-38af-48c9-b08a-0ec90e741b93 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:42.887768 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0035a8a9-38af-48c9-b08a-0ec90e741b93 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:42.888242 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0035a8a9-38af-48c9-b08a-0ec90e741b93 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:43.019873 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0035a8a9-38af-48c9-b08a-0ec90e741b93 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:43.028066 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-0035a8a9-38af-48c9-b08a-0ec90e741b93 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1314 microversion: 2.1 time: 0.155370 Aug 31 00:44:43.028677 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 532/1087] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:42 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:43.428805 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ad8fc998-6ed3-4341-955b-741c2780fe68 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:43.429715 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ad8fc998-6ed3-4341-955b-741c2780fe68 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:43.437439 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ad8fc998-6ed3-4341-955b-741c2780fe68 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:43.438083 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ad8fc998-6ed3-4341-955b-741c2780fe68 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:43.438612 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ad8fc998-6ed3-4341-955b-741c2780fe68 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:43.439476 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ad8fc998-6ed3-4341-955b-741c2780fe68 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:43.440042 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ad8fc998-6ed3-4341-955b-741c2780fe68 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:43.440608 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ad8fc998-6ed3-4341-955b-741c2780fe68 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:43.575697 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ad8fc998-6ed3-4341-955b-741c2780fe68 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:43.583716 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ad8fc998-6ed3-4341-955b-741c2780fe68 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1579 microversion: 2.1 time: 0.160191 Aug 31 00:44:43.584412 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 556/1088] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:43 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:44.049658 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-70f74ff6-e35e-42d3-883d-6e51bd67f677 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:44.050263 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-70f74ff6-e35e-42d3-883d-6e51bd67f677 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:44.057636 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70f74ff6-e35e-42d3-883d-6e51bd67f677 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:44.058113 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70f74ff6-e35e-42d3-883d-6e51bd67f677 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:44.058548 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70f74ff6-e35e-42d3-883d-6e51bd67f677 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:44.059242 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70f74ff6-e35e-42d3-883d-6e51bd67f677 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:44.059769 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70f74ff6-e35e-42d3-883d-6e51bd67f677 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:44.060282 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-70f74ff6-e35e-42d3-883d-6e51bd67f677 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:44.198191 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-70f74ff6-e35e-42d3-883d-6e51bd67f677 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:44.206495 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-70f74ff6-e35e-42d3-883d-6e51bd67f677 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1314 microversion: 2.1 time: 0.160728 Aug 31 00:44:44.207171 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 533/1089] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:44 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:44.606769 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-22d724cf-ff2b-4abc-b522-7e784d4e8925 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:44.607527 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-22d724cf-ff2b-4abc-b522-7e784d4e8925 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:44.614352 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-22d724cf-ff2b-4abc-b522-7e784d4e8925 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:44.619201 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-22d724cf-ff2b-4abc-b522-7e784d4e8925 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:44.619201 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-22d724cf-ff2b-4abc-b522-7e784d4e8925 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:44.619201 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-22d724cf-ff2b-4abc-b522-7e784d4e8925 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:44.619201 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-22d724cf-ff2b-4abc-b522-7e784d4e8925 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:44.620054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-22d724cf-ff2b-4abc-b522-7e784d4e8925 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:44.757916 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-22d724cf-ff2b-4abc-b522-7e784d4e8925 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:44.766842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-22d724cf-ff2b-4abc-b522-7e784d4e8925 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1579 microversion: 2.1 time: 0.163956 Aug 31 00:44:44.767424 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 557/1090] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:44 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1579 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:44:45.228865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-f499e41d-ca93-4dcb-9513-13b6afb37271 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:45.229463 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-f499e41d-ca93-4dcb-9513-13b6afb37271 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:45.236355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f499e41d-ca93-4dcb-9513-13b6afb37271 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:45.236923 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f499e41d-ca93-4dcb-9513-13b6afb37271 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:45.237381 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f499e41d-ca93-4dcb-9513-13b6afb37271 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:45.238078 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f499e41d-ca93-4dcb-9513-13b6afb37271 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:45.238669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f499e41d-ca93-4dcb-9513-13b6afb37271 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:45.239096 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-f499e41d-ca93-4dcb-9513-13b6afb37271 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:45.699377 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-f499e41d-ca93-4dcb-9513-13b6afb37271 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:45.702819 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=100 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:45.708822 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-f499e41d-ca93-4dcb-9513-13b6afb37271 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1314 microversion: 2.1 time: 0.484186 Aug 31 00:44:45.709413 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 534/1091] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:45 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:45.788986 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-375235c4-c7fa-41c0-bb57-cecffc5bbf27 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:45.789622 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-375235c4-c7fa-41c0-bb57-cecffc5bbf27 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:45.798117 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-375235c4-c7fa-41c0-bb57-cecffc5bbf27 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:45.798609 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-375235c4-c7fa-41c0-bb57-cecffc5bbf27 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:45.799075 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-375235c4-c7fa-41c0-bb57-cecffc5bbf27 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:45.799792 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-375235c4-c7fa-41c0-bb57-cecffc5bbf27 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:45.800243 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-375235c4-c7fa-41c0-bb57-cecffc5bbf27 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:45.800720 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-375235c4-c7fa-41c0-bb57-cecffc5bbf27 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:45.955779 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-375235c4-c7fa-41c0-bb57-cecffc5bbf27 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:45.964965 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-375235c4-c7fa-41c0-bb57-cecffc5bbf27 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1579 microversion: 2.1 time: 0.179830 Aug 31 00:44:45.965679 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 558/1092] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:45 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1579 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:46.595330 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-6c485306-b2fa-4968-ba58-95970b0d51cb req-53eb2d03-f290-4162-8605-ee89db2e52cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747", "name": "network-vif-deleted", "tag": "d40a5de5-de00-4fca-9d0f-1539d5f4fc04"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:44:46.606251 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-6c485306-b2fa-4968-ba58-95970b0d51cb req-53eb2d03-f290-4162-8605-ee89db2e52cc service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:46.606733 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-6c485306-b2fa-4968-ba58-95970b0d51cb req-53eb2d03-f290-4162-8605-ee89db2e52cc service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:46.607150 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-6c485306-b2fa-4968-ba58-95970b0d51cb req-53eb2d03-f290-4162-8605-ee89db2e52cc service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:46.620124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-6c485306-b2fa-4968-ba58-95970b0d51cb req-53eb2d03-f290-4162-8605-ee89db2e52cc service nova] Creating event network-vif-deleted:d40a5de5-de00-4fca-9d0f-1539d5f4fc04 for instance 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 on hv-cinder-85221 Aug 31 00:44:46.629602 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-6c485306-b2fa-4968-ba58-95970b0d51cb req-53eb2d03-f290-4162-8605-ee89db2e52cc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035727 Aug 31 00:44:46.629602 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 535/1093] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:44:46.733183 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d3026cb5-81b7-4e86-908a-04ee60c9bf20 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:46.733818 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d3026cb5-81b7-4e86-908a-04ee60c9bf20 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:46.740624 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d3026cb5-81b7-4e86-908a-04ee60c9bf20 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:46.741118 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d3026cb5-81b7-4e86-908a-04ee60c9bf20 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:46.741557 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d3026cb5-81b7-4e86-908a-04ee60c9bf20 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:46.742256 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d3026cb5-81b7-4e86-908a-04ee60c9bf20 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:46.742713 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d3026cb5-81b7-4e86-908a-04ee60c9bf20 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:46.743704 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d3026cb5-81b7-4e86-908a-04ee60c9bf20 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:46.898414 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d3026cb5-81b7-4e86-908a-04ee60c9bf20 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:46.908054 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d3026cb5-81b7-4e86-908a-04ee60c9bf20 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1314 microversion: 2.1 time: 0.178775 Aug 31 00:44:46.909364 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 559/1094] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:46 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:46.988070 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-04fced05-87e2-4e34-96a9-182fd428e6ae tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:46.990291 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-04fced05-87e2-4e34-96a9-182fd428e6ae tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:46.997448 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04fced05-87e2-4e34-96a9-182fd428e6ae tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:46.997937 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04fced05-87e2-4e34-96a9-182fd428e6ae tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:46.998370 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04fced05-87e2-4e34-96a9-182fd428e6ae tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:46.999071 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04fced05-87e2-4e34-96a9-182fd428e6ae tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:46.999518 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04fced05-87e2-4e34-96a9-182fd428e6ae tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:46.999935 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-04fced05-87e2-4e34-96a9-182fd428e6ae tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:47.068296 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-04fced05-87e2-4e34-96a9-182fd428e6ae tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:47.077687 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-04fced05-87e2-4e34-96a9-182fd428e6ae tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1392 microversion: 2.1 time: 0.094860 Aug 31 00:44:47.078369 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 536/1095] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:46 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1392 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:44:47.669365 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c261bee7-fddf-4193-9765-abdf44d0edb1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:47.669861 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c261bee7-fddf-4193-9765-abdf44d0edb1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:47.675962 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c261bee7-fddf-4193-9765-abdf44d0edb1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:47.676530 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c261bee7-fddf-4193-9765-abdf44d0edb1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:47.676967 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c261bee7-fddf-4193-9765-abdf44d0edb1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:47.677657 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c261bee7-fddf-4193-9765-abdf44d0edb1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:47.678111 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c261bee7-fddf-4193-9765-abdf44d0edb1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:47.678537 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c261bee7-fddf-4193-9765-abdf44d0edb1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:47.764454 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-c261bee7-fddf-4193-9765-abdf44d0edb1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lazy-loading 'services' on Instance uuid cebf9a2d-edf8-47d6-b21f-0d46098c892d {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:44:47.931010 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-0df75edf-09bc-46b4-b297-ea296df2b4fe tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:47.931839 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-0df75edf-09bc-46b4-b297-ea296df2b4fe tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:47.939122 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0df75edf-09bc-46b4-b297-ea296df2b4fe tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:47.939426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0df75edf-09bc-46b4-b297-ea296df2b4fe tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:47.939870 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0df75edf-09bc-46b4-b297-ea296df2b4fe tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:47.940591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0df75edf-09bc-46b4-b297-ea296df2b4fe tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:47.941033 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0df75edf-09bc-46b4-b297-ea296df2b4fe tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:47.941452 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0df75edf-09bc-46b4-b297-ea296df2b4fe tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:47.982436 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c261bee7-fddf-4193-9765-abdf44d0edb1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "DELETE /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d/os-volume_attachments/a1ddfb91-e62e-4229-b27f-4a931a78ae96" status: 202 len: 0 microversion: 2.1 time: 0.316386 Aug 31 00:44:47.982436 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 560/1096] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 00:44:47 2022] DELETE /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d/os-volume_attachments/a1ddfb91-e62e-4229-b27f-4a931a78ae96 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:44:48.101258 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-87a914d0-53b8-408b-8b7d-e0bda6514eaf tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:48.102434 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-87a914d0-53b8-408b-8b7d-e0bda6514eaf tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:48.104025 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0df75edf-09bc-46b4-b297-ea296df2b4fe tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:48.112025 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-87a914d0-53b8-408b-8b7d-e0bda6514eaf tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:48.112545 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-87a914d0-53b8-408b-8b7d-e0bda6514eaf tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:48.113759 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-0df75edf-09bc-46b4-b297-ea296df2b4fe tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1314 microversion: 2.1 time: 0.187246 Aug 31 00:44:48.114353 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 537/1097] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:47 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:44:48.118435 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-87a914d0-53b8-408b-8b7d-e0bda6514eaf tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:48.123809 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-87a914d0-53b8-408b-8b7d-e0bda6514eaf tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:48.123809 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-87a914d0-53b8-408b-8b7d-e0bda6514eaf tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:48.123809 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-87a914d0-53b8-408b-8b7d-e0bda6514eaf tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:48.158447 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-87a914d0-53b8-408b-8b7d-e0bda6514eaf tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:48.158447 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-87a914d0-53b8-408b-8b7d-e0bda6514eaf tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:48.158447 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-87a914d0-53b8-408b-8b7d-e0bda6514eaf tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:48.158447 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-87a914d0-53b8-408b-8b7d-e0bda6514eaf tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lazy-loading 'fault' on Instance uuid 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:44:48.201452 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-87a914d0-53b8-408b-8b7d-e0bda6514eaf tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:48.209535 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-87a914d0-53b8-408b-8b7d-e0bda6514eaf tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1231 microversion: 2.1 time: 0.113801 Aug 31 00:44:48.215456 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 561/1098] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:48 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1231 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:49.135933 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-e4459769-ef3c-418e-a898-fb9d54216ae6 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:49.136826 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-e4459769-ef3c-418e-a898-fb9d54216ae6 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:49.143473 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e4459769-ef3c-418e-a898-fb9d54216ae6 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:49.143961 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e4459769-ef3c-418e-a898-fb9d54216ae6 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:49.144423 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e4459769-ef3c-418e-a898-fb9d54216ae6 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:49.145129 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e4459769-ef3c-418e-a898-fb9d54216ae6 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:49.145581 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e4459769-ef3c-418e-a898-fb9d54216ae6 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:49.146004 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-e4459769-ef3c-418e-a898-fb9d54216ae6 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:49.236167 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-57ac0797-210e-46b4-b8f8-7fa7aa711b3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:49.237649 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-57ac0797-210e-46b4-b8f8-7fa7aa711b3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:49.273674 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-57ac0797-210e-46b4-b8f8-7fa7aa711b3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:49.275048 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-57ac0797-210e-46b4-b8f8-7fa7aa711b3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:49.275670 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-57ac0797-210e-46b4-b8f8-7fa7aa711b3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:49.276703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-57ac0797-210e-46b4-b8f8-7fa7aa711b3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:49.277261 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-57ac0797-210e-46b4-b8f8-7fa7aa711b3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:49.277928 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-57ac0797-210e-46b4-b8f8-7fa7aa711b3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:49.334732 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-57ac0797-210e-46b4-b8f8-7fa7aa711b3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:49.335296 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-57ac0797-210e-46b4-b8f8-7fa7aa711b3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:49.336480 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-57ac0797-210e-46b4-b8f8-7fa7aa711b3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:49.337912 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-57ac0797-210e-46b4-b8f8-7fa7aa711b3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lazy-loading 'fault' on Instance uuid 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:44:49.573843 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-57ac0797-210e-46b4-b8f8-7fa7aa711b3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '022c4688d9ce4df9a99ae5fa84e1d871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe5283d88b44f8b824c7bbca56b3473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:49.583258 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-57ac0797-210e-46b4-b8f8-7fa7aa711b3e tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 200 len: 1185 microversion: 2.1 time: 0.353601 Aug 31 00:44:49.584464 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 562/1099] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:49 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 1185 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:44:49.647165 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-e4459769-ef3c-418e-a898-fb9d54216ae6 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:49.657217 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-e4459769-ef3c-418e-a898-fb9d54216ae6 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1314 microversion: 2.1 time: 0.526265 Aug 31 00:44:49.657812 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 538/1100] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:49 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:50.195940 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-9d514496-efe2-494c-a4ac-803bfc4f0ec1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:50.196697 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-9d514496-efe2-494c-a4ac-803bfc4f0ec1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:50.203234 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9d514496-efe2-494c-a4ac-803bfc4f0ec1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:50.203715 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9d514496-efe2-494c-a4ac-803bfc4f0ec1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:50.208582 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9d514496-efe2-494c-a4ac-803bfc4f0ec1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:50.208582 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9d514496-efe2-494c-a4ac-803bfc4f0ec1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:50.208582 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9d514496-efe2-494c-a4ac-803bfc4f0ec1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:50.208582 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-9d514496-efe2-494c-a4ac-803bfc4f0ec1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:50.234285 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-9d514496-efe2-494c-a4ac-803bfc4f0ec1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Going to try to terminate instance {{(pid=128049) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:44:50.577125 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-9d514496-efe2-494c-a4ac-803bfc4f0ec1 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "DELETE /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 204 len: 0 microversion: 2.1 time: 0.384828 Aug 31 00:44:50.577799 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 563/1101] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:44:50 2022] DELETE /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:44:50.586344 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-5bcc292c-2b5a-4f5b-b950-cb73f0371456 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:50.587888 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-5bcc292c-2b5a-4f5b-b950-cb73f0371456 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:50.595687 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5bcc292c-2b5a-4f5b-b950-cb73f0371456 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:50.596185 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5bcc292c-2b5a-4f5b-b950-cb73f0371456 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:50.596669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5bcc292c-2b5a-4f5b-b950-cb73f0371456 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:50.597410 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5bcc292c-2b5a-4f5b-b950-cb73f0371456 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:50.597846 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5bcc292c-2b5a-4f5b-b950-cb73f0371456 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:50.598348 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5bcc292c-2b5a-4f5b-b950-cb73f0371456 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:50.606978 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b0472162-d444-4469-84fe-81f4457642f0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:50.607716 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-b0472162-d444-4469-84fe-81f4457642f0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:50.613774 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b0472162-d444-4469-84fe-81f4457642f0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:50.614264 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b0472162-d444-4469-84fe-81f4457642f0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:50.614748 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b0472162-d444-4469-84fe-81f4457642f0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:50.615453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b0472162-d444-4469-84fe-81f4457642f0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:50.615905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b0472162-d444-4469-84fe-81f4457642f0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:50.616375 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b0472162-d444-4469-84fe-81f4457642f0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:50.630334 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-b0472162-d444-4469-84fe-81f4457642f0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] HTTP exception thrown: Instance 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 could not be found. Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b0472162-d444-4469-84fe-81f4457642f0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Request method failure captured: Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 HTTP/1.1 Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqz6bcJzptONpYzZ--ZxIFkUzMrDN78zWIuu9D1e8slegZKQFDIUR23b9Wk_yos9bDDSwM5IEKLs0-WFJ5UNXiEFrjXcmVGtPeg__15wQjQd90xqU_iIDATE3bR0sdytfyIwr2Fuu6kys33v7DJjsesMlqVcEzLokOVGJK-DL_Q49Ew Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: ebe5283d88b44f8b824c7bbca56b3473 Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-TestVolumeBootPattern-1930465684 Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:44:50.631915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:44:50.633686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:44:50.633686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-TestVolumeBootPattern-1930465684 Aug 31 00:44:50.633686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: ebe5283d88b44f8b824c7bbca56b3473 Aug 31 00:44:50.633686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-TestVolumeBootPattern-1930465684 Aug 31 00:44:50.633686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-TestVolumeBootPattern-1930465684-project Aug 31 00:44:50.633686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:44:50.633686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:44:50.633686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 022c4688d9ce4df9a99ae5fa84e1d871 Aug 31 00:44:50.633686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-TestVolumeBootPattern-1930465684-project Aug 31 00:44:50.633686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:44:50.633686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 could not be found. Aug 31 00:44:50.633686 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': '25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747'} Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 could not be found. Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:44:50.634584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:44:50.636049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:44:50.636049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:44:50.636049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:44:50.636049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:44:50.636049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:44:50.636049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:44:50.636049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:44:50.636049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 could not be found. Aug 31 00:44:50.636049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:44:50.636049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:44:50.636049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:44:50.636049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:44:50.636049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:44:50.636049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:44:50.636049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:44:50.636049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:44:50.636049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 could not be found. Aug 31 00:44:50.636049 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:44:50.637255 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b0472162-d444-4469-84fe-81f4457642f0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Returning 404 to user: Instance 25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:44:50.637255 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-b0472162-d444-4469-84fe-81f4457642f0 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747" status: 404 len: 111 microversion: 2.1 time: 0.031678 Aug 31 00:44:50.637255 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 564/1102] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:50 2022] GET /compute/v2.1/servers/25ad69bf-ba1c-4f5f-a863-1d8bcc7dd747 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:44:50.682597 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d7f1e81c-dd1e-415f-95a2-a6a1644911ac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:50.683433 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d7f1e81c-dd1e-415f-95a2-a6a1644911ac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:50.692620 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d7f1e81c-dd1e-415f-95a2-a6a1644911ac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:50.693753 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d7f1e81c-dd1e-415f-95a2-a6a1644911ac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:50.694874 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d7f1e81c-dd1e-415f-95a2-a6a1644911ac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:50.696440 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d7f1e81c-dd1e-415f-95a2-a6a1644911ac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:50.697255 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d7f1e81c-dd1e-415f-95a2-a6a1644911ac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:50.697739 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d7f1e81c-dd1e-415f-95a2-a6a1644911ac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:50.741222 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-5bcc292c-2b5a-4f5b-b950-cb73f0371456 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:50.749183 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-5bcc292c-2b5a-4f5b-b950-cb73f0371456 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1513 microversion: 2.1 time: 0.166741 Aug 31 00:44:50.749996 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 539/1103] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:50 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:44:50.929926 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d7f1e81c-dd1e-415f-95a2-a6a1644911ac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:50.946685 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d7f1e81c-dd1e-415f-95a2-a6a1644911ac tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1314 microversion: 2.1 time: 0.270562 Aug 31 00:44:50.947662 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 565/1104] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:50 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:44:51.302638 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-6c081ec1-26e6-47d7-981c-0c759a929d73 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:51.303212 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-6c081ec1-26e6-47d7-981c-0c759a929d73 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:51.310338 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6c081ec1-26e6-47d7-981c-0c759a929d73 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:51.310902 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6c081ec1-26e6-47d7-981c-0c759a929d73 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:51.311556 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6c081ec1-26e6-47d7-981c-0c759a929d73 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:51.312420 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6c081ec1-26e6-47d7-981c-0c759a929d73 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:51.312871 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6c081ec1-26e6-47d7-981c-0c759a929d73 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:51.313362 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-6c081ec1-26e6-47d7-981c-0c759a929d73 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:51.328946 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-6c081ec1-26e6-47d7-981c-0c759a929d73 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] HTTP exception thrown: Instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c could not be found. Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-6c081ec1-26e6-47d7-981c-0c759a929d73 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Request method failure captured: Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: DELETE /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c HTTP/1.1 Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDqz6bcJzptONpYzZ--ZxIFkUzMrDN78zWIuu9D1e8slegZKQFDIUR23b9Wk_yos9bDDSwM5IEKLs0-WFJ5UNXiEFrjXcmVGtPeg__15wQjQd90xqU_iIDATE3bR0sdytfyIwr2Fuu6kys33v7DJjsesMlqVcEzLokOVGJK-DL_Q49Ew Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: ebe5283d88b44f8b824c7bbca56b3473 Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-TestVolumeBootPattern-1930465684 Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:44:51.330711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:44:51.332261 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:44:51.332261 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-TestVolumeBootPattern-1930465684 Aug 31 00:44:51.332261 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: ebe5283d88b44f8b824c7bbca56b3473 Aug 31 00:44:51.332261 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-TestVolumeBootPattern-1930465684 Aug 31 00:44:51.332261 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-TestVolumeBootPattern-1930465684-project Aug 31 00:44:51.332261 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:44:51.332261 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:44:51.332261 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 022c4688d9ce4df9a99ae5fa84e1d871 Aug 31 00:44:51.332261 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-TestVolumeBootPattern-1930465684-project Aug 31 00:44:51.332261 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:44:51.332261 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c could not be found. Aug 31 00:44:51.332261 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': 'c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c'} Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c could not be found. Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:44:51.333433 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c could not be found. Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c could not be found. Aug 31 00:44:51.334660 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:44:51.336853 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-6c081ec1-26e6-47d7-981c-0c759a929d73 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Returning 404 to user: Instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:44:51.336853 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-6c081ec1-26e6-47d7-981c-0c759a929d73 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 404 len: 111 microversion: 2.1 time: 0.033885 Aug 31 00:44:51.336853 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 540/1105] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:44:51 2022] DELETE /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:44:51.341095 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b93a7c6b-67f1-4991-8b4d-7f96187f7520 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:51.341711 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-b93a7c6b-67f1-4991-8b4d-7f96187f7520 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] [instance: c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:51.348294 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b93a7c6b-67f1-4991-8b4d-7f96187f7520 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:51.349067 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b93a7c6b-67f1-4991-8b4d-7f96187f7520 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:51.349510 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b93a7c6b-67f1-4991-8b4d-7f96187f7520 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:51.350210 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b93a7c6b-67f1-4991-8b4d-7f96187f7520 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:51.350668 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b93a7c6b-67f1-4991-8b4d-7f96187f7520 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:51.351095 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b93a7c6b-67f1-4991-8b4d-7f96187f7520 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:51.365320 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-b398dd33-4c67-496b-a010-26eeb73ddaab req-73689832-8b96-43bc-b6ee-e01aab024534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "920af99b-43ea-46e0-8873-38efab535745", "name": "network-vif-plugged", "status": "completed", "tag": "14029285-926b-41de-bdc4-a196e9cea3c9"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:44:51.366405 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-b93a7c6b-67f1-4991-8b4d-7f96187f7520 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] HTTP exception thrown: Instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c could not be found. Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b93a7c6b-67f1-4991-8b4d-7f96187f7520 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Request method failure captured: Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c HTTP/1.1 Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDqz6bcJzptONpYzZ--ZxIFkUzMrDN78zWIuu9D1e8slegZKQFDIUR23b9Wk_yos9bDDSwM5IEKLs0-WFJ5UNXiEFrjXcmVGtPeg__15wQjQd90xqU_iIDATE3bR0sdytfyIwr2Fuu6kys33v7DJjsesMlqVcEzLokOVGJK-DL_Q49Ew Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: ebe5283d88b44f8b824c7bbca56b3473 Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-TestVolumeBootPattern-1930465684 Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:44:51.368651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:44:51.370260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ebe5283d88b44f8b824c7bbca56b3473"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:44:51.370260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-TestVolumeBootPattern-1930465684 Aug 31 00:44:51.370260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: ebe5283d88b44f8b824c7bbca56b3473 Aug 31 00:44:51.370260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-TestVolumeBootPattern-1930465684 Aug 31 00:44:51.370260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-TestVolumeBootPattern-1930465684-project Aug 31 00:44:51.370260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:44:51.370260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:44:51.370260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 022c4688d9ce4df9a99ae5fa84e1d871 Aug 31 00:44:51.370260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-TestVolumeBootPattern-1930465684-project Aug 31 00:44:51.370260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:44:51.370260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c could not be found. Aug 31 00:44:51.370260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': 'c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c'} Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c could not be found. Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:44:51.371226 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:44:51.372703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:44:51.372703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:44:51.372703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:44:51.372703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:44:51.372703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:44:51.372703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:44:51.372703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:44:51.372703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c could not be found. Aug 31 00:44:51.372703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:44:51.372703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:44:51.372703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:44:51.372703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:44:51.372703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:44:51.372703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:44:51.372703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:44:51.372703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:44:51.372703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c could not be found. Aug 31 00:44:51.372703 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:44:51.375056 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b93a7c6b-67f1-4991-8b4d-7f96187f7520 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Returning 404 to user: Instance c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:44:51.375926 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-b93a7c6b-67f1-4991-8b4d-7f96187f7520 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c" status: 404 len: 111 microversion: 2.1 time: 0.039009 Aug 31 00:44:51.376579 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 566/1106] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:51 2022] GET /compute/v2.1/servers/c4763bdf-4c9c-4456-9ef9-af42b1b0cb5c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:44:51.377134 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-b398dd33-4c67-496b-a010-26eeb73ddaab req-73689832-8b96-43bc-b6ee-e01aab024534 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:51.377614 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-b398dd33-4c67-496b-a010-26eeb73ddaab req-73689832-8b96-43bc-b6ee-e01aab024534 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:51.378043 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-b398dd33-4c67-496b-a010-26eeb73ddaab req-73689832-8b96-43bc-b6ee-e01aab024534 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:51.393087 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-b398dd33-4c67-496b-a010-26eeb73ddaab req-73689832-8b96-43bc-b6ee-e01aab024534 service nova] Creating event network-vif-plugged:14029285-926b-41de-bdc4-a196e9cea3c9 for instance 920af99b-43ea-46e0-8873-38efab535745 on hv-cinder-85221 Aug 31 00:44:51.398620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-b398dd33-4c67-496b-a010-26eeb73ddaab req-73689832-8b96-43bc-b6ee-e01aab024534 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037101 Aug 31 00:44:51.399339 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 541/1107] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:44:51.771031 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-cdd27a6d-169d-4736-a372-680ad89293d8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:51.771644 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-cdd27a6d-169d-4736-a372-680ad89293d8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:51.778512 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cdd27a6d-169d-4736-a372-680ad89293d8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:51.778995 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cdd27a6d-169d-4736-a372-680ad89293d8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:51.779430 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cdd27a6d-169d-4736-a372-680ad89293d8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:51.780127 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cdd27a6d-169d-4736-a372-680ad89293d8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:51.780600 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cdd27a6d-169d-4736-a372-680ad89293d8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:51.781041 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cdd27a6d-169d-4736-a372-680ad89293d8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:51.922389 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-cdd27a6d-169d-4736-a372-680ad89293d8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:51.931858 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-cdd27a6d-169d-4736-a372-680ad89293d8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1513 microversion: 2.1 time: 0.164472 Aug 31 00:44:51.932476 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 567/1108] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:51 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:51.969369 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ba829578-f9fd-4379-9113-8c6359e6822a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:51.969957 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ba829578-f9fd-4379-9113-8c6359e6822a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:51.976719 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ba829578-f9fd-4379-9113-8c6359e6822a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:51.977229 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ba829578-f9fd-4379-9113-8c6359e6822a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:51.978224 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ba829578-f9fd-4379-9113-8c6359e6822a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:51.978918 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ba829578-f9fd-4379-9113-8c6359e6822a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:51.979354 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ba829578-f9fd-4379-9113-8c6359e6822a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:51.979776 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ba829578-f9fd-4379-9113-8c6359e6822a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:52.125585 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ba829578-f9fd-4379-9113-8c6359e6822a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:52.133858 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ba829578-f9fd-4379-9113-8c6359e6822a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1314 microversion: 2.1 time: 0.168634 Aug 31 00:44:52.134455 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 542/1109] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:51 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:44:52.954528 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-2938f353-00e4-4409-a555-e016580adaac tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:52.956110 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-2938f353-00e4-4409-a555-e016580adaac tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:52.959105 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:52.964120 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2938f353-00e4-4409-a555-e016580adaac tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:52.964726 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2938f353-00e4-4409-a555-e016580adaac tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:52.965166 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2938f353-00e4-4409-a555-e016580adaac tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:52.965942 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2938f353-00e4-4409-a555-e016580adaac tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:52.966446 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2938f353-00e4-4409-a555-e016580adaac tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:52.966804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-2938f353-00e4-4409-a555-e016580adaac tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:53.000421 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-283179d4-ccc0-46ce-8713-dba14f7fbbe2 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] Calling method '.version_select at 0x7f55222c8430>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:53.010095 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:53.095488 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-283179d4-ccc0-46ce-8713-dba14f7fbbe2 tempest-TestVolumeBootPattern-1930465684 tempest-TestVolumeBootPattern-1930465684-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1773331990" status: 202 len: 0 microversion: 2.1 time: 0.100140 Aug 31 00:44:53.096533 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 543/1110] 10.222.0.65 () {58 vars in 1263 bytes} [Wed Aug 31 00:44:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1773331990 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:44:53.124112 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-2938f353-00e4-4409-a555-e016580adaac tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:53.138184 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-2938f353-00e4-4409-a555-e016580adaac tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1513 microversion: 2.1 time: 0.187686 Aug 31 00:44:53.139297 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 568/1111] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:52 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:53.158372 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-cdb1b5dc-6acd-4c7e-8000-90da6085c975 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:53.158372 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-cdb1b5dc-6acd-4c7e-8000-90da6085c975 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:53.162695 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cdb1b5dc-6acd-4c7e-8000-90da6085c975 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:53.163384 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cdb1b5dc-6acd-4c7e-8000-90da6085c975 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:53.164011 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cdb1b5dc-6acd-4c7e-8000-90da6085c975 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:53.165616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cdb1b5dc-6acd-4c7e-8000-90da6085c975 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:53.166283 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cdb1b5dc-6acd-4c7e-8000-90da6085c975 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:53.166771 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cdb1b5dc-6acd-4c7e-8000-90da6085c975 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:53.358705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-cdb1b5dc-6acd-4c7e-8000-90da6085c975 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:53.364584 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-cdb1b5dc-6acd-4c7e-8000-90da6085c975 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1314 microversion: 2.1 time: 0.212528 Aug 31 00:44:53.365193 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 544/1112] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:53 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:53.411461 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-ab22d0bd-f186-4dad-ab14-18ef24752199 req-fe81fa7d-0507-41b1-a75e-143bd14d790f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cebf9a2d-edf8-47d6-b21f-0d46098c892d", "name": "network-vif-deleted", "tag": "61a0644d-28a8-4474-8196-ce23254712ab"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:44:53.422018 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-ab22d0bd-f186-4dad-ab14-18ef24752199 req-fe81fa7d-0507-41b1-a75e-143bd14d790f service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:53.422670 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-ab22d0bd-f186-4dad-ab14-18ef24752199 req-fe81fa7d-0507-41b1-a75e-143bd14d790f service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:53.423088 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-ab22d0bd-f186-4dad-ab14-18ef24752199 req-fe81fa7d-0507-41b1-a75e-143bd14d790f service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:53.427100 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:53.435271 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-ab22d0bd-f186-4dad-ab14-18ef24752199 req-fe81fa7d-0507-41b1-a75e-143bd14d790f service nova] Creating event network-vif-deleted:61a0644d-28a8-4474-8196-ce23254712ab for instance cebf9a2d-edf8-47d6-b21f-0d46098c892d on hv-cinder-85221 Aug 31 00:44:53.440604 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-ab22d0bd-f186-4dad-ab14-18ef24752199 req-fe81fa7d-0507-41b1-a75e-143bd14d790f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034255 Aug 31 00:44:53.441203 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 569/1113] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:44:54.162849 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-0b7a89d2-9780-4880-8849-11db2b13dae6 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:54.163407 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-0b7a89d2-9780-4880-8849-11db2b13dae6 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:54.170699 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0b7a89d2-9780-4880-8849-11db2b13dae6 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:54.171183 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0b7a89d2-9780-4880-8849-11db2b13dae6 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:54.171622 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0b7a89d2-9780-4880-8849-11db2b13dae6 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:54.172364 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0b7a89d2-9780-4880-8849-11db2b13dae6 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:54.172864 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0b7a89d2-9780-4880-8849-11db2b13dae6 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:54.173288 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0b7a89d2-9780-4880-8849-11db2b13dae6 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:54.237633 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0b7a89d2-9780-4880-8849-11db2b13dae6 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:54.245502 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-0b7a89d2-9780-4880-8849-11db2b13dae6 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1471 microversion: 2.1 time: 0.087209 Aug 31 00:44:54.246066 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 545/1114] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:54 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1471 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:54.390952 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-17050342-08ad-47b0-a29a-71c617333ede tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:54.391881 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-17050342-08ad-47b0-a29a-71c617333ede tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:54.401144 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-17050342-08ad-47b0-a29a-71c617333ede tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:54.401734 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-17050342-08ad-47b0-a29a-71c617333ede tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:54.402791 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-17050342-08ad-47b0-a29a-71c617333ede tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:54.403727 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-17050342-08ad-47b0-a29a-71c617333ede tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:54.404365 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-17050342-08ad-47b0-a29a-71c617333ede tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:54.407760 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-17050342-08ad-47b0-a29a-71c617333ede tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:54.904852 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-17050342-08ad-47b0-a29a-71c617333ede tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:54.919423 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-17050342-08ad-47b0-a29a-71c617333ede tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1314 microversion: 2.1 time: 0.536399 Aug 31 00:44:54.920410 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 570/1115] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:54 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:55.267122 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-050e7dee-edaf-4988-b8f2-e05f103e8984 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:55.267896 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-050e7dee-edaf-4988-b8f2-e05f103e8984 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:55.275622 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-050e7dee-edaf-4988-b8f2-e05f103e8984 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:55.276095 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-050e7dee-edaf-4988-b8f2-e05f103e8984 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:55.276751 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-050e7dee-edaf-4988-b8f2-e05f103e8984 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:55.277473 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-050e7dee-edaf-4988-b8f2-e05f103e8984 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:55.277920 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-050e7dee-edaf-4988-b8f2-e05f103e8984 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:55.278331 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-050e7dee-edaf-4988-b8f2-e05f103e8984 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:55.357900 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-050e7dee-edaf-4988-b8f2-e05f103e8984 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:55.366136 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-050e7dee-edaf-4988-b8f2-e05f103e8984 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1471 microversion: 2.1 time: 0.103084 Aug 31 00:44:55.366863 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 546/1116] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:55 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1471 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:55.941282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d9069f01-3a49-4e43-9df9-66680de574ad tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:55.945600 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d9069f01-3a49-4e43-9df9-66680de574ad tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:55.951751 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d9069f01-3a49-4e43-9df9-66680de574ad tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:55.952260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d9069f01-3a49-4e43-9df9-66680de574ad tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:55.952720 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d9069f01-3a49-4e43-9df9-66680de574ad tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:55.953423 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d9069f01-3a49-4e43-9df9-66680de574ad tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:55.953869 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d9069f01-3a49-4e43-9df9-66680de574ad tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:55.954421 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d9069f01-3a49-4e43-9df9-66680de574ad tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:56.107409 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d9069f01-3a49-4e43-9df9-66680de574ad tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:56.116999 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d9069f01-3a49-4e43-9df9-66680de574ad tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1314 microversion: 2.1 time: 0.179573 Aug 31 00:44:56.117629 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 571/1117] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:55 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:56.388355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-511b5b80-76f6-4d2e-b10d-d7d9ffc9c036 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:56.388896 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-511b5b80-76f6-4d2e-b10d-d7d9ffc9c036 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:56.395505 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-511b5b80-76f6-4d2e-b10d-d7d9ffc9c036 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:56.395993 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-511b5b80-76f6-4d2e-b10d-d7d9ffc9c036 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:56.396460 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-511b5b80-76f6-4d2e-b10d-d7d9ffc9c036 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:56.397190 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-511b5b80-76f6-4d2e-b10d-d7d9ffc9c036 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:56.397651 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-511b5b80-76f6-4d2e-b10d-d7d9ffc9c036 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:56.398313 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-511b5b80-76f6-4d2e-b10d-d7d9ffc9c036 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:56.433887 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-511b5b80-76f6-4d2e-b10d-d7d9ffc9c036 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:56.434332 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-511b5b80-76f6-4d2e-b10d-d7d9ffc9c036 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:56.436801 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-511b5b80-76f6-4d2e-b10d-d7d9ffc9c036 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:56.437547 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-511b5b80-76f6-4d2e-b10d-d7d9ffc9c036 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lazy-loading 'fault' on Instance uuid cebf9a2d-edf8-47d6-b21f-0d46098c892d {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:44:56.495514 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-511b5b80-76f6-4d2e-b10d-d7d9ffc9c036 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:56.507512 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-511b5b80-76f6-4d2e-b10d-d7d9ffc9c036 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1309 microversion: 2.1 time: 0.123087 Aug 31 00:44:56.510509 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 547/1118] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:56 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1309 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:57.146189 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-0fcb2e5e-5ca6-469d-93d3-3cbfd4731fd1 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:57.147383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-0fcb2e5e-5ca6-469d-93d3-3cbfd4731fd1 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:57.154817 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0fcb2e5e-5ca6-469d-93d3-3cbfd4731fd1 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:57.155713 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0fcb2e5e-5ca6-469d-93d3-3cbfd4731fd1 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:57.156605 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0fcb2e5e-5ca6-469d-93d3-3cbfd4731fd1 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:57.157651 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0fcb2e5e-5ca6-469d-93d3-3cbfd4731fd1 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:57.158387 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0fcb2e5e-5ca6-469d-93d3-3cbfd4731fd1 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:57.158823 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-0fcb2e5e-5ca6-469d-93d3-3cbfd4731fd1 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:57.316453 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-0fcb2e5e-5ca6-469d-93d3-3cbfd4731fd1 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:57.325571 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-0fcb2e5e-5ca6-469d-93d3-3cbfd4731fd1 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1464 microversion: 2.1 time: 0.183824 Aug 31 00:44:57.327123 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 572/1119] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:57 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1464 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:57.372258 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-775e156d-09c5-4af4-87dc-f95543b17e3b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:57.372922 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-775e156d-09c5-4af4-87dc-f95543b17e3b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:57.379079 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-775e156d-09c5-4af4-87dc-f95543b17e3b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:57.381083 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-775e156d-09c5-4af4-87dc-f95543b17e3b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:57.381083 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-775e156d-09c5-4af4-87dc-f95543b17e3b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:57.381083 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-775e156d-09c5-4af4-87dc-f95543b17e3b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:57.382240 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-775e156d-09c5-4af4-87dc-f95543b17e3b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:57.382680 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-775e156d-09c5-4af4-87dc-f95543b17e3b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:57.410650 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-775e156d-09c5-4af4-87dc-f95543b17e3b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Going to try to terminate instance {{(pid=128048) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:44:57.529694 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-fee020f7-6a2f-4ed4-a2ba-d732aabfef0c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:57.530344 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-fee020f7-6a2f-4ed4-a2ba-d732aabfef0c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:57.536750 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fee020f7-6a2f-4ed4-a2ba-d732aabfef0c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:57.537256 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fee020f7-6a2f-4ed4-a2ba-d732aabfef0c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:57.537714 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fee020f7-6a2f-4ed4-a2ba-d732aabfef0c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:57.538435 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fee020f7-6a2f-4ed4-a2ba-d732aabfef0c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:57.538897 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fee020f7-6a2f-4ed4-a2ba-d732aabfef0c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:57.539328 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fee020f7-6a2f-4ed4-a2ba-d732aabfef0c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:57.572955 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fee020f7-6a2f-4ed4-a2ba-d732aabfef0c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:57.573441 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fee020f7-6a2f-4ed4-a2ba-d732aabfef0c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:57.573881 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fee020f7-6a2f-4ed4-a2ba-d732aabfef0c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:57.574335 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-fee020f7-6a2f-4ed4-a2ba-d732aabfef0c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lazy-loading 'fault' on Instance uuid cebf9a2d-edf8-47d6-b21f-0d46098c892d {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:44:57.619936 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-fee020f7-6a2f-4ed4-a2ba-d732aabfef0c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:57.635285 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-fee020f7-6a2f-4ed4-a2ba-d732aabfef0c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 200 len: 1309 microversion: 2.1 time: 0.109475 Aug 31 00:44:57.636743 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 573/1120] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:57 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:57.696930 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-775e156d-09c5-4af4-87dc-f95543b17e3b tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "DELETE /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 204 len: 0 microversion: 2.1 time: 0.328415 Aug 31 00:44:57.703366 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 548/1121] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:44:57 2022] DELETE /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:44:57.710023 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-bbfa676f-df2a-455e-8645-f9f9afd90086 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:57.711097 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-bbfa676f-df2a-455e-8645-f9f9afd90086 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:57.718415 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bbfa676f-df2a-455e-8645-f9f9afd90086 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:57.718902 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bbfa676f-df2a-455e-8645-f9f9afd90086 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:57.719333 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bbfa676f-df2a-455e-8645-f9f9afd90086 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:57.720033 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bbfa676f-df2a-455e-8645-f9f9afd90086 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:57.720616 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bbfa676f-df2a-455e-8645-f9f9afd90086 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:57.721045 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bbfa676f-df2a-455e-8645-f9f9afd90086 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:57.861824 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-bbfa676f-df2a-455e-8645-f9f9afd90086 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:57.870296 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-bbfa676f-df2a-455e-8645-f9f9afd90086 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1470 microversion: 2.1 time: 0.166947 Aug 31 00:44:57.871078 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 574/1122] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:57 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:44:58.658006 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a1363045-8378-4d6d-8995-24e37e9d2722 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:58.658845 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-a1363045-8378-4d6d-8995-24e37e9d2722 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: cebf9a2d-edf8-47d6-b21f-0d46098c892d] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:58.666387 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a1363045-8378-4d6d-8995-24e37e9d2722 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:58.666970 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a1363045-8378-4d6d-8995-24e37e9d2722 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:58.667783 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a1363045-8378-4d6d-8995-24e37e9d2722 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:58.668772 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a1363045-8378-4d6d-8995-24e37e9d2722 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:58.668772 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a1363045-8378-4d6d-8995-24e37e9d2722 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:58.669097 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-a1363045-8378-4d6d-8995-24e37e9d2722 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:58.692062 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-a1363045-8378-4d6d-8995-24e37e9d2722 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] HTTP exception thrown: Instance cebf9a2d-edf8-47d6-b21f-0d46098c892d could not be found. Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a1363045-8378-4d6d-8995-24e37e9d2722 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Request method failure captured: Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d HTTP/1.1 Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDq6gtcOyf8gNSMXJhURSFuRpu8polycWQn5vsp2eyrh0ABCxDr_ybWnI6FJOOGfLIdcBhMlMAWvcq-S92xsC1cwWIiAu_M9yoU_zb4RnCfFs9RT1fwFi_y_Rua6HFHebTA_XgDcI1ci_P4zPUfA7xYWh1r3NvzvgbDTf2EJNRIxc61w Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: 644ca4166ff846fb944c2b39f0263abe Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-VolumesSnapshotTestJSON-240431918 Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:44:58.694112 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:44:58.695601 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/644ca4166ff846fb944c2b39f0263abe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/644ca4166ff846fb944c2b39f0263abe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/644ca4166ff846fb944c2b39f0263abe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_644ca4166ff846fb944c2b39f0263abe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:44:58.695601 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-VolumesSnapshotTestJSON-240431918 Aug 31 00:44:58.695601 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: 644ca4166ff846fb944c2b39f0263abe Aug 31 00:44:58.695601 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-240431918 Aug 31 00:44:58.695601 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-VolumesSnapshotTestJSON-240431918-project Aug 31 00:44:58.695601 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:44:58.695601 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:44:58.695601 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 4c936369a3ff4138833cfc81a1104f20 Aug 31 00:44:58.695601 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-VolumesSnapshotTestJSON-240431918-project Aug 31 00:44:58.695601 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:44:58.695601 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance cebf9a2d-edf8-47d6-b21f-0d46098c892d could not be found. Aug 31 00:44:58.695601 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': 'cebf9a2d-edf8-47d6-b21f-0d46098c892d'} Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cebf9a2d-edf8-47d6-b21f-0d46098c892d could not be found. Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:44:58.697205 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:44:58.698679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:44:58.698679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:44:58.698679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:44:58.698679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:44:58.698679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:44:58.698679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:44:58.698679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:44:58.698679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cebf9a2d-edf8-47d6-b21f-0d46098c892d could not be found. Aug 31 00:44:58.698679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:44:58.698679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:44:58.698679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:44:58.698679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:44:58.698679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:44:58.698679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:44:58.698679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:44:58.698679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:44:58.698679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cebf9a2d-edf8-47d6-b21f-0d46098c892d could not be found. Aug 31 00:44:58.698679 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:44:58.701861 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-a1363045-8378-4d6d-8995-24e37e9d2722 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Returning 404 to user: Instance cebf9a2d-edf8-47d6-b21f-0d46098c892d could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:44:58.702844 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-a1363045-8378-4d6d-8995-24e37e9d2722 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d" status: 404 len: 111 microversion: 2.1 time: 0.049186 Aug 31 00:44:58.714168 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 549/1123] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:58 2022] GET /compute/v2.1/servers/cebf9a2d-edf8-47d6-b21f-0d46098c892d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:44:58.891472 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6a23a749-feee-4185-a746-70d0681fe2f7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:44:58.892050 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6a23a749-feee-4185-a746-70d0681fe2f7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:44:58.898716 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6a23a749-feee-4185-a746-70d0681fe2f7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:58.899204 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6a23a749-feee-4185-a746-70d0681fe2f7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:58.899672 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6a23a749-feee-4185-a746-70d0681fe2f7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:58.900425 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6a23a749-feee-4185-a746-70d0681fe2f7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:44:58.900906 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6a23a749-feee-4185-a746-70d0681fe2f7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:44:58.901336 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6a23a749-feee-4185-a746-70d0681fe2f7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:44:59.044502 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6a23a749-feee-4185-a746-70d0681fe2f7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:44:59.052523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6a23a749-feee-4185-a746-70d0681fe2f7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1470 microversion: 2.1 time: 0.165182 Aug 31 00:44:59.053129 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 575/1124] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:44:58 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:00.081818 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-2e62a379-5651-4ba3-a291-fb10602aed8d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:00.081818 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-2e62a379-5651-4ba3-a291-fb10602aed8d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:00.082355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2e62a379-5651-4ba3-a291-fb10602aed8d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:00.082510 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2e62a379-5651-4ba3-a291-fb10602aed8d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:00.083003 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2e62a379-5651-4ba3-a291-fb10602aed8d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:00.083718 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2e62a379-5651-4ba3-a291-fb10602aed8d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:00.084162 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2e62a379-5651-4ba3-a291-fb10602aed8d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:00.084632 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2e62a379-5651-4ba3-a291-fb10602aed8d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:00.257830 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-2e62a379-5651-4ba3-a291-fb10602aed8d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:00.265616 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-2e62a379-5651-4ba3-a291-fb10602aed8d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1470 microversion: 2.1 time: 0.195240 Aug 31 00:45:00.266192 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 550/1125] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:00 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1470 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:01.289098 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-89e360d7-ecfd-46cc-9203-4064ba1fc782 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:01.290069 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-89e360d7-ecfd-46cc-9203-4064ba1fc782 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:01.297457 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-89e360d7-ecfd-46cc-9203-4064ba1fc782 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:01.297946 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-89e360d7-ecfd-46cc-9203-4064ba1fc782 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:01.298379 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-89e360d7-ecfd-46cc-9203-4064ba1fc782 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:01.299079 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-89e360d7-ecfd-46cc-9203-4064ba1fc782 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:01.299519 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-89e360d7-ecfd-46cc-9203-4064ba1fc782 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:01.299955 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-89e360d7-ecfd-46cc-9203-4064ba1fc782 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:01.446354 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-89e360d7-ecfd-46cc-9203-4064ba1fc782 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:01.454407 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-89e360d7-ecfd-46cc-9203-4064ba1fc782 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1470 microversion: 2.1 time: 0.169926 Aug 31 00:45:01.458831 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 576/1126] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:01 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1470 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:02.475975 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-01f1d7c5-15f9-4acd-a1fe-fab7217fcc66 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:02.476860 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-01f1d7c5-15f9-4acd-a1fe-fab7217fcc66 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:02.484243 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-01f1d7c5-15f9-4acd-a1fe-fab7217fcc66 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:02.491543 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-01f1d7c5-15f9-4acd-a1fe-fab7217fcc66 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:02.491543 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-01f1d7c5-15f9-4acd-a1fe-fab7217fcc66 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:02.491543 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-01f1d7c5-15f9-4acd-a1fe-fab7217fcc66 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:02.491543 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-01f1d7c5-15f9-4acd-a1fe-fab7217fcc66 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:02.493251 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-01f1d7c5-15f9-4acd-a1fe-fab7217fcc66 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:02.626199 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-01f1d7c5-15f9-4acd-a1fe-fab7217fcc66 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:02.634676 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-01f1d7c5-15f9-4acd-a1fe-fab7217fcc66 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1470 microversion: 2.1 time: 0.162635 Aug 31 00:45:02.635234 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 551/1127] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:02 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:03.656292 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-1e88bf7c-200d-427c-8a8f-3fb9da328d5a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:03.656942 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-1e88bf7c-200d-427c-8a8f-3fb9da328d5a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:03.663429 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1e88bf7c-200d-427c-8a8f-3fb9da328d5a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:03.663896 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1e88bf7c-200d-427c-8a8f-3fb9da328d5a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:03.664807 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1e88bf7c-200d-427c-8a8f-3fb9da328d5a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:03.665740 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1e88bf7c-200d-427c-8a8f-3fb9da328d5a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:03.666190 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1e88bf7c-200d-427c-8a8f-3fb9da328d5a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:03.666605 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-1e88bf7c-200d-427c-8a8f-3fb9da328d5a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:03.813236 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-1e88bf7c-200d-427c-8a8f-3fb9da328d5a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:03.821862 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-1e88bf7c-200d-427c-8a8f-3fb9da328d5a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1470 microversion: 2.1 time: 0.169428 Aug 31 00:45:03.827011 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 577/1128] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:03 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:04.844150 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-db14f8df-49e2-4226-82cc-8adf769e9220 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:04.844793 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-db14f8df-49e2-4226-82cc-8adf769e9220 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:04.851252 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-db14f8df-49e2-4226-82cc-8adf769e9220 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:04.851731 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-db14f8df-49e2-4226-82cc-8adf769e9220 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:04.852793 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-db14f8df-49e2-4226-82cc-8adf769e9220 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:04.853478 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-db14f8df-49e2-4226-82cc-8adf769e9220 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:04.853935 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-db14f8df-49e2-4226-82cc-8adf769e9220 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:04.854353 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-db14f8df-49e2-4226-82cc-8adf769e9220 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:05.005609 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-db14f8df-49e2-4226-82cc-8adf769e9220 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:05.013484 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-db14f8df-49e2-4226-82cc-8adf769e9220 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1470 microversion: 2.1 time: 0.173392 Aug 31 00:45:05.014037 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 552/1129] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:04 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1470 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:06.035807 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-8b193ebc-e8c2-4675-9824-86e5b0b5166a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:06.036420 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-8b193ebc-e8c2-4675-9824-86e5b0b5166a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:06.043365 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b193ebc-e8c2-4675-9824-86e5b0b5166a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:06.043850 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b193ebc-e8c2-4675-9824-86e5b0b5166a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:06.044286 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b193ebc-e8c2-4675-9824-86e5b0b5166a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:06.045012 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b193ebc-e8c2-4675-9824-86e5b0b5166a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:06.045462 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b193ebc-e8c2-4675-9824-86e5b0b5166a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:06.045881 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-8b193ebc-e8c2-4675-9824-86e5b0b5166a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:06.185598 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-8b193ebc-e8c2-4675-9824-86e5b0b5166a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:06.193533 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-8b193ebc-e8c2-4675-9824-86e5b0b5166a tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1470 microversion: 2.1 time: 0.161666 Aug 31 00:45:06.194096 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 578/1130] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:06 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:07.216515 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-14f0c31e-5dde-472d-9a68-3367be0a0674 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:07.217755 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-14f0c31e-5dde-472d-9a68-3367be0a0674 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:07.224401 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-14f0c31e-5dde-472d-9a68-3367be0a0674 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:07.224873 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-14f0c31e-5dde-472d-9a68-3367be0a0674 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:07.225918 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-14f0c31e-5dde-472d-9a68-3367be0a0674 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:07.226058 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-14f0c31e-5dde-472d-9a68-3367be0a0674 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:07.226419 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-14f0c31e-5dde-472d-9a68-3367be0a0674 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:07.226902 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-14f0c31e-5dde-472d-9a68-3367be0a0674 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:07.233610 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:07.438556 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-14f0c31e-5dde-472d-9a68-3367be0a0674 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:07.455171 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-14f0c31e-5dde-472d-9a68-3367be0a0674 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1470 microversion: 2.1 time: 0.236891 Aug 31 00:45:07.455171 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 553/1131] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:07 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1470 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:08.246408 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-a86060a5-576b-4e83-9853-95b395ef4df6 req-09a54fa4-f8ee-4c23-90b6-ca595d59caff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "920af99b-43ea-46e0-8873-38efab535745", "name": "network-vif-deleted", "tag": "14029285-926b-41de-bdc4-a196e9cea3c9"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:45:08.262628 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-a86060a5-576b-4e83-9853-95b395ef4df6 req-09a54fa4-f8ee-4c23-90b6-ca595d59caff service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:08.263195 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-a86060a5-576b-4e83-9853-95b395ef4df6 req-09a54fa4-f8ee-4c23-90b6-ca595d59caff service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:08.263747 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-a86060a5-576b-4e83-9853-95b395ef4df6 req-09a54fa4-f8ee-4c23-90b6-ca595d59caff service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:08.277526 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-a86060a5-576b-4e83-9853-95b395ef4df6 req-09a54fa4-f8ee-4c23-90b6-ca595d59caff service nova] Creating event network-vif-deleted:14029285-926b-41de-bdc4-a196e9cea3c9 for instance 920af99b-43ea-46e0-8873-38efab535745 on hv-cinder-85221 Aug 31 00:45:08.283305 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-a86060a5-576b-4e83-9853-95b395ef4df6 req-09a54fa4-f8ee-4c23-90b6-ca595d59caff service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044901 Aug 31 00:45:08.284198 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 579/1132] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:45:08.471416 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-1da16aeb-cb5f-4876-a027-59fb8192c4dd tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:08.471966 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-1da16aeb-cb5f-4876-a027-59fb8192c4dd tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:08.480029 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1da16aeb-cb5f-4876-a027-59fb8192c4dd tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:08.480564 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1da16aeb-cb5f-4876-a027-59fb8192c4dd tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:08.481042 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1da16aeb-cb5f-4876-a027-59fb8192c4dd tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:08.482956 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1da16aeb-cb5f-4876-a027-59fb8192c4dd tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:08.482956 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1da16aeb-cb5f-4876-a027-59fb8192c4dd tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:08.482956 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1da16aeb-cb5f-4876-a027-59fb8192c4dd tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:08.546855 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-1da16aeb-cb5f-4876-a027-59fb8192c4dd tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:08.556138 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-1da16aeb-cb5f-4876-a027-59fb8192c4dd tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1299 microversion: 2.1 time: 0.089009 Aug 31 00:45:08.556768 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 554/1133] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:08 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:09.578205 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-6aa3d487-43ae-4f32-9cdc-39308ca99b73 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:09.578901 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-6aa3d487-43ae-4f32-9cdc-39308ca99b73 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:09.585731 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6aa3d487-43ae-4f32-9cdc-39308ca99b73 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:09.586953 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6aa3d487-43ae-4f32-9cdc-39308ca99b73 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:09.587541 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6aa3d487-43ae-4f32-9cdc-39308ca99b73 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:09.588150 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6aa3d487-43ae-4f32-9cdc-39308ca99b73 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:09.588649 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6aa3d487-43ae-4f32-9cdc-39308ca99b73 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:09.591846 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6aa3d487-43ae-4f32-9cdc-39308ca99b73 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:09.622889 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6aa3d487-43ae-4f32-9cdc-39308ca99b73 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:09.623363 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6aa3d487-43ae-4f32-9cdc-39308ca99b73 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:09.623790 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-6aa3d487-43ae-4f32-9cdc-39308ca99b73 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:09.624474 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-6aa3d487-43ae-4f32-9cdc-39308ca99b73 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lazy-loading 'fault' on Instance uuid 920af99b-43ea-46e0-8873-38efab535745 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:45:09.667295 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-6aa3d487-43ae-4f32-9cdc-39308ca99b73 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:09.675235 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-6aa3d487-43ae-4f32-9cdc-39308ca99b73 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1304 microversion: 2.1 time: 0.101285 Aug 31 00:45:09.675803 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 580/1134] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:09 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:10.698351 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-1cca76ea-f327-4f82-b6ed-236631e7d3af tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:10.698901 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-1cca76ea-f327-4f82-b6ed-236631e7d3af tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:10.705521 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1cca76ea-f327-4f82-b6ed-236631e7d3af tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:10.705999 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1cca76ea-f327-4f82-b6ed-236631e7d3af tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:10.706421 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1cca76ea-f327-4f82-b6ed-236631e7d3af tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:10.707115 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1cca76ea-f327-4f82-b6ed-236631e7d3af tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:10.707560 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1cca76ea-f327-4f82-b6ed-236631e7d3af tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:10.707970 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1cca76ea-f327-4f82-b6ed-236631e7d3af tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:10.743072 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1cca76ea-f327-4f82-b6ed-236631e7d3af tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:10.743823 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1cca76ea-f327-4f82-b6ed-236631e7d3af tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:10.744603 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1cca76ea-f327-4f82-b6ed-236631e7d3af tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:10.744603 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-1cca76ea-f327-4f82-b6ed-236631e7d3af tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lazy-loading 'fault' on Instance uuid 920af99b-43ea-46e0-8873-38efab535745 {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:45:10.786382 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-1cca76ea-f327-4f82-b6ed-236631e7d3af tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:10.795145 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-1cca76ea-f327-4f82-b6ed-236631e7d3af tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1304 microversion: 2.1 time: 0.101164 Aug 31 00:45:10.795714 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 555/1135] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:10 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:11.815702 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c8680017-f1e6-40f9-82e0-8fcc546a360d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:11.816480 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c8680017-f1e6-40f9-82e0-8fcc546a360d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:11.824208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c8680017-f1e6-40f9-82e0-8fcc546a360d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:11.824715 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c8680017-f1e6-40f9-82e0-8fcc546a360d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:11.827959 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c8680017-f1e6-40f9-82e0-8fcc546a360d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:11.827959 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c8680017-f1e6-40f9-82e0-8fcc546a360d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:11.827959 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c8680017-f1e6-40f9-82e0-8fcc546a360d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:11.827959 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c8680017-f1e6-40f9-82e0-8fcc546a360d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:11.860038 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c8680017-f1e6-40f9-82e0-8fcc546a360d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:11.860575 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c8680017-f1e6-40f9-82e0-8fcc546a360d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:11.861014 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c8680017-f1e6-40f9-82e0-8fcc546a360d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:11.861457 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-c8680017-f1e6-40f9-82e0-8fcc546a360d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lazy-loading 'fault' on Instance uuid 920af99b-43ea-46e0-8873-38efab535745 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:45:11.906551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-c8680017-f1e6-40f9-82e0-8fcc546a360d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282cf38c59c4445ca943236cd9a08ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4aa358ff1064f05968fff832ea588ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:11.913932 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c8680017-f1e6-40f9-82e0-8fcc546a360d tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 200 len: 1304 microversion: 2.1 time: 0.102148 Aug 31 00:45:11.915131 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 581/1136] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:11 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:12.562955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-34a93f34-9e35-4bbd-a103-d1c4763c6097 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-777597064", "imageRef": "12947ed8-8ca9-442d-9224-509e79a198e7", "flavorRef": "452", "networks": [{"uuid": "ad14b10b-3e63-42af-b57a-cefcc3328996"}]}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:45:12.627207 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.network.neutron [None req-34a93f34-9e35-4bbd-a103-d1c4763c6097 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] validate_networks() for [('ad14b10b-3e63-42af-b57a-cefcc3328996', None, None, None, None, None)] {{(pid=128048) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:45:12.936085 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3fcde3c0-28d8-409b-b77c-0efa9141e9c7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:12.937027 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-3fcde3c0-28d8-409b-b77c-0efa9141e9c7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] [instance: 920af99b-43ea-46e0-8873-38efab535745] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:12.943629 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3fcde3c0-28d8-409b-b77c-0efa9141e9c7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:12.944146 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3fcde3c0-28d8-409b-b77c-0efa9141e9c7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:12.944670 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3fcde3c0-28d8-409b-b77c-0efa9141e9c7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:12.945368 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3fcde3c0-28d8-409b-b77c-0efa9141e9c7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:12.945816 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3fcde3c0-28d8-409b-b77c-0efa9141e9c7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:12.946231 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-3fcde3c0-28d8-409b-b77c-0efa9141e9c7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:12.960209 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-3fcde3c0-28d8-409b-b77c-0efa9141e9c7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] HTTP exception thrown: Instance 920af99b-43ea-46e0-8873-38efab535745 could not be found. Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3fcde3c0-28d8-409b-b77c-0efa9141e9c7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Request method failure captured: Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 HTTP/1.1 Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDq7eQiu7SGwKWPYu0g3RzMbb8kXMI9_OkG5f0cDubaWTz-3--moCGWmyGQ4F4qW-GiK5gXToSGhPiSzYC8gDFhFbS6SHu5bUqGE5jr6FGDbutMJ2VFcud15OhjBmofPBEV_ZXO_lGp_fRs63fdGcn81PqIHKdgDbrPkkdBcsYlm9ETA Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: f4aa358ff1064f05968fff832ea588ee Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-VolumesNegativeTest-1620970628 Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:45:12.964782 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:45:12.966208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f4aa358ff1064f05968fff832ea588ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f4aa358ff1064f05968fff832ea588ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f4aa358ff1064f05968fff832ea588ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f4aa358ff1064f05968fff832ea588ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:45:12.966208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-VolumesNegativeTest-1620970628 Aug 31 00:45:12.966208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: f4aa358ff1064f05968fff832ea588ee Aug 31 00:45:12.966208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-VolumesNegativeTest-1620970628 Aug 31 00:45:12.966208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-VolumesNegativeTest-1620970628-project Aug 31 00:45:12.966208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:45:12.966208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:45:12.966208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 282cf38c59c4445ca943236cd9a08ec6 Aug 31 00:45:12.966208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-VolumesNegativeTest-1620970628-project Aug 31 00:45:12.966208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:45:12.966208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance 920af99b-43ea-46e0-8873-38efab535745 could not be found. Aug 31 00:45:12.966208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': '920af99b-43ea-46e0-8873-38efab535745'} Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 920af99b-43ea-46e0-8873-38efab535745 could not be found. Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:45:12.967070 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:45:12.968383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:45:12.968383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:45:12.968383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:45:12.968383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:45:12.968383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:45:12.968383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:45:12.968383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:45:12.968383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 920af99b-43ea-46e0-8873-38efab535745 could not be found. Aug 31 00:45:12.968383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:45:12.968383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:45:12.968383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:45:12.968383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:45:12.968383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:45:12.968383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:45:12.968383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:45:12.968383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:45:12.968383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 920af99b-43ea-46e0-8873-38efab535745 could not be found. Aug 31 00:45:12.968383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:45:12.969618 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-3fcde3c0-28d8-409b-b77c-0efa9141e9c7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] Returning 404 to user: Instance 920af99b-43ea-46e0-8873-38efab535745 could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:45:12.969618 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-3fcde3c0-28d8-409b-b77c-0efa9141e9c7 tempest-VolumesNegativeTest-1620970628 tempest-VolumesNegativeTest-1620970628-project] 10.222.0.65 "GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745" status: 404 len: 111 microversion: 2.1 time: 0.031928 Aug 31 00:45:12.969618 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 582/1137] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:12 2022] GET /compute/v2.1/servers/920af99b-43ea-46e0-8873-38efab535745 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 00:45:13.012376 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-34a93f34-9e35-4bbd-a103-d1c4763c6097 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Flavor limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:45:13.013336 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-34a93f34-9e35-4bbd-a103-d1c4763c6097 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Image limits 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:45:13.013813 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-34a93f34-9e35-4bbd-a103-d1c4763c6097 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Flavor pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:45:13.014228 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-34a93f34-9e35-4bbd-a103-d1c4763c6097 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Image pref 0:0:0 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:45:13.014638 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.virt.hardware [None req-34a93f34-9e35-4bbd-a103-d1c4763c6097 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:45:13.024730 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-34a93f34-9e35-4bbd-a103-d1c4763c6097 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:13.025295 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-34a93f34-9e35-4bbd-a103-d1c4763c6097 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:13.026059 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-34a93f34-9e35-4bbd-a103-d1c4763c6097 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:13.027347 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-34a93f34-9e35-4bbd-a103-d1c4763c6097 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:13.027820 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-34a93f34-9e35-4bbd-a103-d1c4763c6097 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:13.028252 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-34a93f34-9e35-4bbd-a103-d1c4763c6097 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:13.046009 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-34a93f34-9e35-4bbd-a103-d1c4763c6097 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Getting quotas for project 644ca4166ff846fb944c2b39f0263abe. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:45:13.050039 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-34a93f34-9e35-4bbd-a103-d1c4763c6097 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Getting quotas for user 4c936369a3ff4138833cfc81a1104f20 and project 644ca4166ff846fb944c2b39f0263abe. Resources: {'ram', 'cores', 'instances'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:45:13.061449 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-34a93f34-9e35-4bbd-a103-d1c4763c6097 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Going to run 1 instances... {{(pid=128048) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:45:13.063761 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-34a93f34-9e35-4bbd-a103-d1c4763c6097 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12947ed8-8ca9-442d-9224-509e79a198e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128048) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:45:13.231151 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-34a93f34-9e35-4bbd-a103-d1c4763c6097 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672049 Aug 31 00:45:13.231806 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 556/1138] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:45:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:45:13.243650 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-cc591a1a-98e8-4ec5-96ef-8df6b87589a2 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:13.244391 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-cc591a1a-98e8-4ec5-96ef-8df6b87589a2 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:13.309062 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-cc591a1a-98e8-4ec5-96ef-8df6b87589a2 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:13.316795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-cc591a1a-98e8-4ec5-96ef-8df6b87589a2 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c" status: 200 len: 1218 microversion: 2.1 time: 0.077821 Aug 31 00:45:13.317372 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 583/1139] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:13 2022] GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:45:14.341440 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-36324229-aaac-4668-a292-8e5d2523269c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:14.342190 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-36324229-aaac-4668-a292-8e5d2523269c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:14.350871 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-36324229-aaac-4668-a292-8e5d2523269c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:14.351364 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-36324229-aaac-4668-a292-8e5d2523269c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:14.352412 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-36324229-aaac-4668-a292-8e5d2523269c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:14.353308 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-36324229-aaac-4668-a292-8e5d2523269c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:14.353767 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-36324229-aaac-4668-a292-8e5d2523269c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:14.354191 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-36324229-aaac-4668-a292-8e5d2523269c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:14.430917 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-36324229-aaac-4668-a292-8e5d2523269c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:14.445208 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-36324229-aaac-4668-a292-8e5d2523269c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c" status: 200 len: 1222 microversion: 2.1 time: 0.108145 Aug 31 00:45:14.446583 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 557/1140] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:14 2022] GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c => generated 1222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:15.470988 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a43461ae-f51a-48aa-bfb5-517816fba98c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:15.471614 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a43461ae-f51a-48aa-bfb5-517816fba98c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:15.481459 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a43461ae-f51a-48aa-bfb5-517816fba98c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:15.481987 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a43461ae-f51a-48aa-bfb5-517816fba98c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:15.482389 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a43461ae-f51a-48aa-bfb5-517816fba98c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:15.484138 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a43461ae-f51a-48aa-bfb5-517816fba98c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:15.484138 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a43461ae-f51a-48aa-bfb5-517816fba98c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:15.484138 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a43461ae-f51a-48aa-bfb5-517816fba98c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:15.563243 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a43461ae-f51a-48aa-bfb5-517816fba98c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:15.574866 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a43461ae-f51a-48aa-bfb5-517816fba98c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c" status: 200 len: 1270 microversion: 2.1 time: 0.108112 Aug 31 00:45:15.575643 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 584/1141] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:15 2022] GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c => generated 1270 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:16.606225 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-4329dd81-c2f6-474c-8949-a5381462d388 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:16.606225 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-4329dd81-c2f6-474c-8949-a5381462d388 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:16.613261 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4329dd81-c2f6-474c-8949-a5381462d388 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:16.614135 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4329dd81-c2f6-474c-8949-a5381462d388 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:16.615047 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4329dd81-c2f6-474c-8949-a5381462d388 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:16.616905 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4329dd81-c2f6-474c-8949-a5381462d388 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:16.618357 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4329dd81-c2f6-474c-8949-a5381462d388 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:16.619041 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-4329dd81-c2f6-474c-8949-a5381462d388 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:16.789972 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-4329dd81-c2f6-474c-8949-a5381462d388 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:16.798862 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-4329dd81-c2f6-474c-8949-a5381462d388 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c" status: 200 len: 1318 microversion: 2.1 time: 0.200951 Aug 31 00:45:16.799443 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 558/1142] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:16 2022] GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:17.767702 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-b204dfc0-2513-40d4-a578-bd13ce466d61 req-afa4b2d1-5dab-4fbc-bf36-2fa6804cbbff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29c839a0-df66-4eec-8f4a-bf2160a9614c", "tag": "f625dbe5-be40-4583-b5d1-459287f0f584"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:45:17.781055 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-b204dfc0-2513-40d4-a578-bd13ce466d61 req-afa4b2d1-5dab-4fbc-bf36-2fa6804cbbff service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:17.781525 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-b204dfc0-2513-40d4-a578-bd13ce466d61 req-afa4b2d1-5dab-4fbc-bf36-2fa6804cbbff service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:17.782013 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-b204dfc0-2513-40d4-a578-bd13ce466d61 req-afa4b2d1-5dab-4fbc-bf36-2fa6804cbbff service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:17.794737 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-b204dfc0-2513-40d4-a578-bd13ce466d61 req-afa4b2d1-5dab-4fbc-bf36-2fa6804cbbff service nova] Creating event network-changed:f625dbe5-be40-4583-b5d1-459287f0f584 for instance 29c839a0-df66-4eec-8f4a-bf2160a9614c on hv-cinder-85221 Aug 31 00:45:17.799884 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-b204dfc0-2513-40d4-a578-bd13ce466d61 req-afa4b2d1-5dab-4fbc-bf36-2fa6804cbbff service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038859 Aug 31 00:45:17.800566 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 585/1143] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:45:17.821566 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-384b14c2-291e-47cc-b1a4-7ff054c837c4 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:17.826624 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-384b14c2-291e-47cc-b1a4-7ff054c837c4 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:17.835242 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-384b14c2-291e-47cc-b1a4-7ff054c837c4 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:17.835739 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-384b14c2-291e-47cc-b1a4-7ff054c837c4 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:17.836979 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-384b14c2-291e-47cc-b1a4-7ff054c837c4 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:17.837946 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-384b14c2-291e-47cc-b1a4-7ff054c837c4 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:17.838655 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-384b14c2-291e-47cc-b1a4-7ff054c837c4 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:17.845863 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-384b14c2-291e-47cc-b1a4-7ff054c837c4 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:18.067330 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-384b14c2-291e-47cc-b1a4-7ff054c837c4 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:18.080934 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-384b14c2-291e-47cc-b1a4-7ff054c837c4 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c" status: 200 len: 1318 microversion: 2.1 time: 0.262740 Aug 31 00:45:18.080934 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 559/1144] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:17 2022] GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:19.102674 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a07f43da-e201-437a-ad82-1e461b252369 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:19.103381 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a07f43da-e201-437a-ad82-1e461b252369 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:19.109679 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a07f43da-e201-437a-ad82-1e461b252369 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:19.110221 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a07f43da-e201-437a-ad82-1e461b252369 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:19.111855 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a07f43da-e201-437a-ad82-1e461b252369 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:19.111855 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a07f43da-e201-437a-ad82-1e461b252369 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:19.111855 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a07f43da-e201-437a-ad82-1e461b252369 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:19.112353 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a07f43da-e201-437a-ad82-1e461b252369 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:19.250964 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a07f43da-e201-437a-ad82-1e461b252369 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:19.260300 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a07f43da-e201-437a-ad82-1e461b252369 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c" status: 200 len: 1318 microversion: 2.1 time: 0.162730 Aug 31 00:45:19.260508 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 586/1145] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:19 2022] GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:20.281962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c3e03577-5a29-4906-b493-32c678c39e71 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:20.282601 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c3e03577-5a29-4906-b493-32c678c39e71 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:20.289502 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c3e03577-5a29-4906-b493-32c678c39e71 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:20.289997 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c3e03577-5a29-4906-b493-32c678c39e71 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:20.290424 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c3e03577-5a29-4906-b493-32c678c39e71 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:20.291113 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c3e03577-5a29-4906-b493-32c678c39e71 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:20.291554 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c3e03577-5a29-4906-b493-32c678c39e71 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:20.291970 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c3e03577-5a29-4906-b493-32c678c39e71 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:20.488490 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c3e03577-5a29-4906-b493-32c678c39e71 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:20.496815 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-c3e03577-5a29-4906-b493-32c678c39e71 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c" status: 200 len: 1318 microversion: 2.1 time: 0.218917 Aug 31 00:45:20.497473 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 560/1146] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:20 2022] GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:21.517801 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a6d16a1d-0b6c-4671-9d27-efc278e90e72 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:21.518423 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a6d16a1d-0b6c-4671-9d27-efc278e90e72 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:21.525123 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6d16a1d-0b6c-4671-9d27-efc278e90e72 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:21.525599 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6d16a1d-0b6c-4671-9d27-efc278e90e72 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:21.526032 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6d16a1d-0b6c-4671-9d27-efc278e90e72 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:21.526721 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6d16a1d-0b6c-4671-9d27-efc278e90e72 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:21.527166 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6d16a1d-0b6c-4671-9d27-efc278e90e72 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:21.527579 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a6d16a1d-0b6c-4671-9d27-efc278e90e72 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:21.661332 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a6d16a1d-0b6c-4671-9d27-efc278e90e72 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:21.669840 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a6d16a1d-0b6c-4671-9d27-efc278e90e72 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c" status: 200 len: 1318 microversion: 2.1 time: 0.155772 Aug 31 00:45:21.670607 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 587/1147] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:21 2022] GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:22.691897 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-03b50db6-503e-46d8-94dc-5dd87a4c7b95 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:22.692449 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-03b50db6-503e-46d8-94dc-5dd87a4c7b95 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:22.699594 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-03b50db6-503e-46d8-94dc-5dd87a4c7b95 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:22.700075 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-03b50db6-503e-46d8-94dc-5dd87a4c7b95 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:22.700539 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-03b50db6-503e-46d8-94dc-5dd87a4c7b95 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:22.701222 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-03b50db6-503e-46d8-94dc-5dd87a4c7b95 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:22.701667 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-03b50db6-503e-46d8-94dc-5dd87a4c7b95 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:22.702083 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-03b50db6-503e-46d8-94dc-5dd87a4c7b95 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:22.907266 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-03b50db6-503e-46d8-94dc-5dd87a4c7b95 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:22.915092 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-03b50db6-503e-46d8-94dc-5dd87a4c7b95 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c" status: 200 len: 1318 microversion: 2.1 time: 0.227113 Aug 31 00:45:22.915662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 561/1148] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:22 2022] GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:23.936289 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c2df7dc1-209e-4fe4-a9ee-57dfcb5abf36 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:23.936934 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c2df7dc1-209e-4fe4-a9ee-57dfcb5abf36 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:23.940137 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=2 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:23.946222 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c2df7dc1-209e-4fe4-a9ee-57dfcb5abf36 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:23.946542 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c2df7dc1-209e-4fe4-a9ee-57dfcb5abf36 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:23.947188 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c2df7dc1-209e-4fe4-a9ee-57dfcb5abf36 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:23.947895 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c2df7dc1-209e-4fe4-a9ee-57dfcb5abf36 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:23.948372 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c2df7dc1-209e-4fe4-a9ee-57dfcb5abf36 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:23.948798 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c2df7dc1-209e-4fe4-a9ee-57dfcb5abf36 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:23.969270 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=100 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:24.094574 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-c2df7dc1-209e-4fe4-a9ee-57dfcb5abf36 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:24.102592 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c2df7dc1-209e-4fe4-a9ee-57dfcb5abf36 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c" status: 200 len: 1318 microversion: 2.1 time: 0.170252 Aug 31 00:45:24.103173 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 588/1149] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:23 2022] GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:25.124385 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-cd82437c-65ac-4022-a78e-2edbe90d298a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:25.125423 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-cd82437c-65ac-4022-a78e-2edbe90d298a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:25.127551 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:25.128295 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=6 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:25.129594 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:25.137044 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cd82437c-65ac-4022-a78e-2edbe90d298a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:25.137815 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cd82437c-65ac-4022-a78e-2edbe90d298a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:25.138253 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cd82437c-65ac-4022-a78e-2edbe90d298a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:25.138960 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cd82437c-65ac-4022-a78e-2edbe90d298a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:25.139415 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cd82437c-65ac-4022-a78e-2edbe90d298a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:25.139837 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-cd82437c-65ac-4022-a78e-2edbe90d298a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:25.189102 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-873e82de-842b-4ded-a1d0-160e1e26f051 req-f4a0081a-4693-4b07-a232-23f83de16405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c839a0-df66-4eec-8f4a-bf2160a9614c", "name": "network-vif-plugged", "status": "completed", "tag": "f625dbe5-be40-4583-b5d1-459287f0f584"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:45:25.196650 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=50 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:25.202466 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-873e82de-842b-4ded-a1d0-160e1e26f051 req-f4a0081a-4693-4b07-a232-23f83de16405 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:25.203053 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-873e82de-842b-4ded-a1d0-160e1e26f051 req-f4a0081a-4693-4b07-a232-23f83de16405 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:25.203666 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-873e82de-842b-4ded-a1d0-160e1e26f051 req-f4a0081a-4693-4b07-a232-23f83de16405 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:25.216419 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-873e82de-842b-4ded-a1d0-160e1e26f051 req-f4a0081a-4693-4b07-a232-23f83de16405 service nova] Creating event network-vif-plugged:f625dbe5-be40-4583-b5d1-459287f0f584 for instance 29c839a0-df66-4eec-8f4a-bf2160a9614c on hv-cinder-85221 Aug 31 00:45:25.222065 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-873e82de-842b-4ded-a1d0-160e1e26f051 req-f4a0081a-4693-4b07-a232-23f83de16405 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036752 Aug 31 00:45:25.222799 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 589/1150] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:45:25.377559 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-cd82437c-65ac-4022-a78e-2edbe90d298a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:25.393481 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-cd82437c-65ac-4022-a78e-2edbe90d298a tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c" status: 200 len: 1318 microversion: 2.1 time: 0.273268 Aug 31 00:45:25.397426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 562/1151] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:25 2022] GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:26.418088 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-f9a01fab-6caf-448f-b34d-14fe1d3f6b34 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:26.419825 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-f9a01fab-6caf-448f-b34d-14fe1d3f6b34 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:26.435238 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9a01fab-6caf-448f-b34d-14fe1d3f6b34 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:26.435976 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9a01fab-6caf-448f-b34d-14fe1d3f6b34 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:26.437262 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9a01fab-6caf-448f-b34d-14fe1d3f6b34 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:26.438479 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9a01fab-6caf-448f-b34d-14fe1d3f6b34 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:26.439102 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9a01fab-6caf-448f-b34d-14fe1d3f6b34 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:26.439677 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-f9a01fab-6caf-448f-b34d-14fe1d3f6b34 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:26.719039 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-f9a01fab-6caf-448f-b34d-14fe1d3f6b34 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:26.728838 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-f9a01fab-6caf-448f-b34d-14fe1d3f6b34 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c" status: 200 len: 1318 microversion: 2.1 time: 0.316893 Aug 31 00:45:26.729432 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 590/1152] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:26 2022] GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:27.750356 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d5887c7b-2a5c-431f-bc3d-8d38bcdcdfc8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:27.751186 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d5887c7b-2a5c-431f-bc3d-8d38bcdcdfc8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:27.760240 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d5887c7b-2a5c-431f-bc3d-8d38bcdcdfc8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:27.761123 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d5887c7b-2a5c-431f-bc3d-8d38bcdcdfc8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:27.761566 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d5887c7b-2a5c-431f-bc3d-8d38bcdcdfc8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:27.762290 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d5887c7b-2a5c-431f-bc3d-8d38bcdcdfc8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:27.762752 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d5887c7b-2a5c-431f-bc3d-8d38bcdcdfc8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:27.763229 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d5887c7b-2a5c-431f-bc3d-8d38bcdcdfc8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:27.955591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d5887c7b-2a5c-431f-bc3d-8d38bcdcdfc8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:27.964352 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d5887c7b-2a5c-431f-bc3d-8d38bcdcdfc8 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c" status: 200 len: 1507 microversion: 2.1 time: 0.218304 Aug 31 00:45:27.965229 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 563/1153] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:27 2022] GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c => generated 1507 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:27.989805 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-57149382-833e-4d48-92cb-6a77c390aa6f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9c28e93-88e4-4d8c-a480-114d340d20a1", "device": "/dev/sdb"}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:45:27.993264 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-57149382-833e-4d48-92cb-6a77c390aa6f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:27.999967 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-57149382-833e-4d48-92cb-6a77c390aa6f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:28.000512 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-57149382-833e-4d48-92cb-6a77c390aa6f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:28.000950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-57149382-833e-4d48-92cb-6a77c390aa6f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:28.001662 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-57149382-833e-4d48-92cb-6a77c390aa6f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:28.002112 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-57149382-833e-4d48-92cb-6a77c390aa6f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:28.002535 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-57149382-833e-4d48-92cb-6a77c390aa6f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:29.060892 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-57149382-833e-4d48-92cb-6a77c390aa6f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "POST /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.077679 Aug 31 00:45:29.062176 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 591/1154] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 00:45:27 2022] POST /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c/os-volume_attachments => generated 194 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:45:45.989309 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-eb606aa7-8d36-4580-8be5-c28d4b7e60a5 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Action: 'create', calling method: .version_select at 0x7f551eadbca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-193571907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlQcgFxZOtXN0PUVGjn3R9ku0K9b9Xb3fo33n6lUM3WAz8mJvKlOpC0hQhndgKO6s8N/jnzkhsNB9VUrZKpxkP04jkbkTILaqmS4tk7dJGHAGkxmGxQQFzzqX+sDrAotA=="}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:45:45.995239 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=62 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:46.006466 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-eb606aa7-8d36-4580-8be5-c28d4b7e60a5 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Getting quotas for project 3737c99210b64eac8d7d75f53c1e2cac. Resources: {'key_pairs'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:45:46.010494 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.quota [None req-eb606aa7-8d36-4580-8be5-c28d4b7e60a5 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Getting quotas for user 23fc9f06d2bb4a0fbc0fc01dda38b522 and project 3737c99210b64eac8d7d75f53c1e2cac. Resources: {'key_pairs'} {{(pid=128048) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:45:46.096254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-eb606aa7-8d36-4580-8be5-c28d4b7e60a5 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.111277 Aug 31 00:45:46.097071 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 564/1155] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 31 00:45:45 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:45:46.146159 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=5 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:46.146931 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:46.151768 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-7269697f-f0b3-40ba-b7f4-ec832d074f34 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1065191832", "imageRef": "be2ac2c9-b3d5-4b2b-ba35-615a4a246beb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-193571907", "networks": [{"uuid": "93b4f966-f3f2-4460-a28d-2d1c471bf707"}]}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:45:46.204943 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.network.neutron [None req-7269697f-f0b3-40ba-b7f4-ec832d074f34 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] validate_networks() for [('93b4f966-f3f2-4460-a28d-2d1c471bf707', None, None, None, None, None)] {{(pid=128049) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 00:45:46.689127 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-7269697f-f0b3-40ba-b7f4-ec832d074f34 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Flavor limits 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 00:45:46.689546 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-7269697f-f0b3-40ba-b7f4-ec832d074f34 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Image limits 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 00:45:46.690040 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-7269697f-f0b3-40ba-b7f4-ec832d074f34 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Flavor pref 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 00:45:46.690440 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-7269697f-f0b3-40ba-b7f4-ec832d074f34 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Image pref 0:0:0 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 00:45:46.690899 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.virt.hardware [None req-7269697f-f0b3-40ba-b7f4-ec832d074f34 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 00:45:46.700582 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7269697f-f0b3-40ba-b7f4-ec832d074f34 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:46.702194 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7269697f-f0b3-40ba-b7f4-ec832d074f34 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:46.702194 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7269697f-f0b3-40ba-b7f4-ec832d074f34 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:46.702194 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7269697f-f0b3-40ba-b7f4-ec832d074f34 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:46.702601 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7269697f-f0b3-40ba-b7f4-ec832d074f34 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:46.703018 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7269697f-f0b3-40ba-b7f4-ec832d074f34 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:46.719957 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-7269697f-f0b3-40ba-b7f4-ec832d074f34 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Getting quotas for project 3737c99210b64eac8d7d75f53c1e2cac. Resources: {'ram', 'cores', 'instances'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 00:45:46.723922 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.quota [None req-7269697f-f0b3-40ba-b7f4-ec832d074f34 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Getting quotas for user 23fc9f06d2bb4a0fbc0fc01dda38b522 and project 3737c99210b64eac8d7d75f53c1e2cac. Resources: {'ram', 'cores', 'instances'} {{(pid=128049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 00:45:46.737077 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-7269697f-f0b3-40ba-b7f4-ec832d074f34 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Going to run 1 instances... {{(pid=128049) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 00:45:46.739648 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-7269697f-f0b3-40ba-b7f4-ec832d074f34 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='be2ac2c9-b3d5-4b2b-ba35-615a4a246beb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 00:45:46.852625 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-7269697f-f0b3-40ba-b7f4-ec832d074f34 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707530 Aug 31 00:45:46.853179 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 592/1156] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 31 00:45:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 00:45:46.864909 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c3208b38-4d4c-480d-981b-e5d53f273f0b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:46.865547 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c3208b38-4d4c-480d-981b-e5d53f273f0b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:47.187817 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c3208b38-4d4c-480d-981b-e5d53f273f0b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:47.195739 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-c3208b38-4d4c-480d-981b-e5d53f273f0b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1258 microversion: 2.1 time: 0.335667 Aug 31 00:45:47.196289 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 565/1157] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:46 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1258 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:45:48.217724 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-cf0cbbfd-c0f2-49bd-ad61-d9d8a84faf7d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:48.218333 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-cf0cbbfd-c0f2-49bd-ad61-d9d8a84faf7d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:48.225600 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cf0cbbfd-c0f2-49bd-ad61-d9d8a84faf7d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:48.226074 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cf0cbbfd-c0f2-49bd-ad61-d9d8a84faf7d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:48.226501 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cf0cbbfd-c0f2-49bd-ad61-d9d8a84faf7d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:48.228091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cf0cbbfd-c0f2-49bd-ad61-d9d8a84faf7d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:48.228553 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cf0cbbfd-c0f2-49bd-ad61-d9d8a84faf7d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:48.228972 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cf0cbbfd-c0f2-49bd-ad61-d9d8a84faf7d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:48.293768 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-cf0cbbfd-c0f2-49bd-ad61-d9d8a84faf7d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:48.301893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-cf0cbbfd-c0f2-49bd-ad61-d9d8a84faf7d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1262 microversion: 2.1 time: 0.088924 Aug 31 00:45:48.302444 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 593/1158] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:48 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:49.322684 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d5dc146a-e359-4c73-9639-3eee0861eadb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:49.323353 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d5dc146a-e359-4c73-9639-3eee0861eadb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:49.329982 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d5dc146a-e359-4c73-9639-3eee0861eadb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:49.330496 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d5dc146a-e359-4c73-9639-3eee0861eadb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:49.330934 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d5dc146a-e359-4c73-9639-3eee0861eadb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:49.331629 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d5dc146a-e359-4c73-9639-3eee0861eadb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:49.332081 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d5dc146a-e359-4c73-9639-3eee0861eadb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:49.332557 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d5dc146a-e359-4c73-9639-3eee0861eadb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:49.399475 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d5dc146a-e359-4c73-9639-3eee0861eadb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:49.408043 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d5dc146a-e359-4c73-9639-3eee0861eadb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1310 microversion: 2.1 time: 0.089330 Aug 31 00:45:49.408664 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 566/1159] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:49 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1310 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:50.147157 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-970ada26-547e-42d0-b1a3-4ec93e29be3f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:50.148440 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-970ada26-547e-42d0-b1a3-4ec93e29be3f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:50.155680 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-970ada26-547e-42d0-b1a3-4ec93e29be3f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:50.156171 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-970ada26-547e-42d0-b1a3-4ec93e29be3f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:50.156673 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-970ada26-547e-42d0-b1a3-4ec93e29be3f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:50.157358 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-970ada26-547e-42d0-b1a3-4ec93e29be3f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:50.157870 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-970ada26-547e-42d0-b1a3-4ec93e29be3f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:50.158482 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-970ada26-547e-42d0-b1a3-4ec93e29be3f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:50.249630 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-970ada26-547e-42d0-b1a3-4ec93e29be3f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lazy-loading 'services' on Instance uuid 29c839a0-df66-4eec-8f4a-bf2160a9614c {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:45:50.446279 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c7f746a3-1de7-4d38-9a0a-3c69226456c6 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:50.450592 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c7f746a3-1de7-4d38-9a0a-3c69226456c6 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:50.465017 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c7f746a3-1de7-4d38-9a0a-3c69226456c6 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:50.466630 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c7f746a3-1de7-4d38-9a0a-3c69226456c6 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:50.468208 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c7f746a3-1de7-4d38-9a0a-3c69226456c6 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:50.470340 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c7f746a3-1de7-4d38-9a0a-3c69226456c6 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:50.471640 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c7f746a3-1de7-4d38-9a0a-3c69226456c6 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:50.472900 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c7f746a3-1de7-4d38-9a0a-3c69226456c6 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:50.495778 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-970ada26-547e-42d0-b1a3-4ec93e29be3f tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "DELETE /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c/os-volume_attachments/a9c28e93-88e4-4d8c-a480-114d340d20a1" status: 202 len: 0 microversion: 2.1 time: 0.352408 Aug 31 00:45:50.496533 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 594/1160] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 00:45:50 2022] DELETE /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c/os-volume_attachments/a9c28e93-88e4-4d8c-a480-114d340d20a1 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:45:50.710621 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c7f746a3-1de7-4d38-9a0a-3c69226456c6 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:50.730515 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-c7f746a3-1de7-4d38-9a0a-3c69226456c6 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1358 microversion: 2.1 time: 0.296201 Aug 31 00:45:50.754973 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 567/1161] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:50 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1358 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:51.758911 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-59ca38ef-18e6-439f-967c-96145f80602d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:51.759585 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-59ca38ef-18e6-439f-967c-96145f80602d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:51.766594 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-59ca38ef-18e6-439f-967c-96145f80602d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:51.767077 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-59ca38ef-18e6-439f-967c-96145f80602d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:51.767546 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-59ca38ef-18e6-439f-967c-96145f80602d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:51.768460 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-59ca38ef-18e6-439f-967c-96145f80602d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:51.768915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-59ca38ef-18e6-439f-967c-96145f80602d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:51.769368 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-59ca38ef-18e6-439f-967c-96145f80602d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:51.931873 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-59ca38ef-18e6-439f-967c-96145f80602d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:51.942846 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-59ca38ef-18e6-439f-967c-96145f80602d tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1358 microversion: 2.1 time: 0.189262 Aug 31 00:45:51.944055 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 595/1162] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:51 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:52.964386 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-2c1625fd-9175-4975-93c4-1a7beec75842 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:52.965174 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-2c1625fd-9175-4975-93c4-1a7beec75842 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:52.971667 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2c1625fd-9175-4975-93c4-1a7beec75842 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:52.972243 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2c1625fd-9175-4975-93c4-1a7beec75842 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:52.972776 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2c1625fd-9175-4975-93c4-1a7beec75842 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:52.973556 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2c1625fd-9175-4975-93c4-1a7beec75842 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:52.974078 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2c1625fd-9175-4975-93c4-1a7beec75842 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:52.974598 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2c1625fd-9175-4975-93c4-1a7beec75842 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:53.118894 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-2c1625fd-9175-4975-93c4-1a7beec75842 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:53.128821 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-2c1625fd-9175-4975-93c4-1a7beec75842 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1358 microversion: 2.1 time: 0.169321 Aug 31 00:45:53.130191 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 568/1163] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:52 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:54.152434 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4575ae19-c919-446d-a563-2a9d3b331633 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:54.153153 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4575ae19-c919-446d-a563-2a9d3b331633 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:54.159236 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4575ae19-c919-446d-a563-2a9d3b331633 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:54.159724 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4575ae19-c919-446d-a563-2a9d3b331633 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:54.160164 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4575ae19-c919-446d-a563-2a9d3b331633 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:54.160890 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4575ae19-c919-446d-a563-2a9d3b331633 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:54.161341 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4575ae19-c919-446d-a563-2a9d3b331633 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:54.161764 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4575ae19-c919-446d-a563-2a9d3b331633 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:54.301091 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4575ae19-c919-446d-a563-2a9d3b331633 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:54.313350 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4575ae19-c919-446d-a563-2a9d3b331633 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1358 microversion: 2.1 time: 0.166130 Aug 31 00:45:54.324312 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 596/1164] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:54 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:55.335849 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ec13d792-3920-4644-9859-a45d2b9e4d47 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:55.337598 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ec13d792-3920-4644-9859-a45d2b9e4d47 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:55.346699 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ec13d792-3920-4644-9859-a45d2b9e4d47 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:55.347410 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ec13d792-3920-4644-9859-a45d2b9e4d47 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:55.347852 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ec13d792-3920-4644-9859-a45d2b9e4d47 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:55.348589 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ec13d792-3920-4644-9859-a45d2b9e4d47 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:55.349035 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ec13d792-3920-4644-9859-a45d2b9e4d47 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:55.349453 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ec13d792-3920-4644-9859-a45d2b9e4d47 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:55.533637 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ec13d792-3920-4644-9859-a45d2b9e4d47 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:55.544526 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ec13d792-3920-4644-9859-a45d2b9e4d47 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1358 microversion: 2.1 time: 0.212875 Aug 31 00:45:55.547455 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 569/1165] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:55 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:56.566200 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-246ecc01-f142-4233-bafe-545e3e07b7d4 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:56.566899 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-246ecc01-f142-4233-bafe-545e3e07b7d4 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:56.574851 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-246ecc01-f142-4233-bafe-545e3e07b7d4 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:56.575333 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-246ecc01-f142-4233-bafe-545e3e07b7d4 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:56.575768 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-246ecc01-f142-4233-bafe-545e3e07b7d4 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:56.576599 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-246ecc01-f142-4233-bafe-545e3e07b7d4 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:56.577058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-246ecc01-f142-4233-bafe-545e3e07b7d4 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:56.577476 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-246ecc01-f142-4233-bafe-545e3e07b7d4 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:56.710711 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=2 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:56.731436 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell0:SELECT=6 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:56.738052 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-246ecc01-f142-4233-bafe-545e3e07b7d4 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:56.755283 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-246ecc01-f142-4233-bafe-545e3e07b7d4 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1358 microversion: 2.1 time: 0.192390 Aug 31 00:45:56.765915 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 597/1166] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:56 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:45:57.778435 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7c05f7cf-b34b-478a-87da-ef6aba718a7c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:57.779697 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7c05f7cf-b34b-478a-87da-ef6aba718a7c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:57.782144 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=6 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:57.786962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7c05f7cf-b34b-478a-87da-ef6aba718a7c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:57.787442 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7c05f7cf-b34b-478a-87da-ef6aba718a7c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:57.787877 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7c05f7cf-b34b-478a-87da-ef6aba718a7c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:57.788711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7c05f7cf-b34b-478a-87da-ef6aba718a7c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:57.789219 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7c05f7cf-b34b-478a-87da-ef6aba718a7c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:57.789880 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7c05f7cf-b34b-478a-87da-ef6aba718a7c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:57.932457 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-7c05f7cf-b34b-478a-87da-ef6aba718a7c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:57.940381 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-7c05f7cf-b34b-478a-87da-ef6aba718a7c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1358 microversion: 2.1 time: 0.167175 Aug 31 00:45:57.940949 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 570/1167] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:57 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:58.963419 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ae13cdb5-e321-4d02-aeb5-a017807d084c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:45:58.964917 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ae13cdb5-e321-4d02-aeb5-a017807d084c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:45:58.973561 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ae13cdb5-e321-4d02-aeb5-a017807d084c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:58.974160 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ae13cdb5-e321-4d02-aeb5-a017807d084c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:58.974598 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ae13cdb5-e321-4d02-aeb5-a017807d084c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:58.975302 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ae13cdb5-e321-4d02-aeb5-a017807d084c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:58.975748 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ae13cdb5-e321-4d02-aeb5-a017807d084c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:58.977450 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ae13cdb5-e321-4d02-aeb5-a017807d084c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:59.127505 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ae13cdb5-e321-4d02-aeb5-a017807d084c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:45:59.137339 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ae13cdb5-e321-4d02-aeb5-a017807d084c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1358 microversion: 2.1 time: 0.178422 Aug 31 00:45:59.137896 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 598/1168] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:45:58 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:45:59.279481 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-da17c678-7c8f-4b80-b7cc-947d7fc278d9 req-e0f55b6e-0190-40a6-b275-b23ae800d016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06", "tag": "4573bb31-6b4a-4232-8e8a-7c6328b04848"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:45:59.289620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-da17c678-7c8f-4b80-b7cc-947d7fc278d9 req-e0f55b6e-0190-40a6-b275-b23ae800d016 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:45:59.290141 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-da17c678-7c8f-4b80-b7cc-947d7fc278d9 req-e0f55b6e-0190-40a6-b275-b23ae800d016 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:45:59.290569 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-da17c678-7c8f-4b80-b7cc-947d7fc278d9 req-e0f55b6e-0190-40a6-b275-b23ae800d016 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:45:59.301794 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-da17c678-7c8f-4b80-b7cc-947d7fc278d9 req-e0f55b6e-0190-40a6-b275-b23ae800d016 service nova] Creating event network-changed:4573bb31-6b4a-4232-8e8a-7c6328b04848 for instance b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 on hv-cinder-85221 Aug 31 00:45:59.307682 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-da17c678-7c8f-4b80-b7cc-947d7fc278d9 req-e0f55b6e-0190-40a6-b275-b23ae800d016 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159115 Aug 31 00:45:59.308289 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 571/1169] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:46:00.160365 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-a74c60b8-4fb6-4583-8f54-918b24707d5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:00.161095 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-a74c60b8-4fb6-4583-8f54-918b24707d5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:00.167653 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a74c60b8-4fb6-4583-8f54-918b24707d5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:00.168139 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a74c60b8-4fb6-4583-8f54-918b24707d5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:00.168607 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a74c60b8-4fb6-4583-8f54-918b24707d5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:00.169304 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a74c60b8-4fb6-4583-8f54-918b24707d5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:00.169755 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a74c60b8-4fb6-4583-8f54-918b24707d5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:00.170177 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-a74c60b8-4fb6-4583-8f54-918b24707d5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:00.203686 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-2d84df80-14db-49d8-b0ca-9175a33a3f04 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:00.204258 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-2d84df80-14db-49d8-b0ca-9175a33a3f04 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:00.210682 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2d84df80-14db-49d8-b0ca-9175a33a3f04 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:00.211198 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2d84df80-14db-49d8-b0ca-9175a33a3f04 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:00.211692 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2d84df80-14db-49d8-b0ca-9175a33a3f04 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:00.212426 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2d84df80-14db-49d8-b0ca-9175a33a3f04 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:00.212878 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2d84df80-14db-49d8-b0ca-9175a33a3f04 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:00.213296 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2d84df80-14db-49d8-b0ca-9175a33a3f04 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:00.239159 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-2d84df80-14db-49d8-b0ca-9175a33a3f04 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Going to try to terminate instance {{(pid=128048) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:46:00.301934 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-a74c60b8-4fb6-4583-8f54-918b24707d5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:00.310292 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-a74c60b8-4fb6-4583-8f54-918b24707d5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1358 microversion: 2.1 time: 0.153752 Aug 31 00:46:00.310884 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 599/1170] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:00 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:00.486685 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-2d84df80-14db-49d8-b0ca-9175a33a3f04 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "DELETE /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c" status: 204 len: 0 microversion: 2.1 time: 0.287412 Aug 31 00:46:00.487272 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 572/1171] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:46:00 2022] DELETE /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 00:46:00.496063 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-4f3fc0c4-0ce9-498a-9127-7319f2610509 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:00.496711 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-4f3fc0c4-0ce9-498a-9127-7319f2610509 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:00.502763 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4f3fc0c4-0ce9-498a-9127-7319f2610509 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:00.503243 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4f3fc0c4-0ce9-498a-9127-7319f2610509 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:00.503680 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4f3fc0c4-0ce9-498a-9127-7319f2610509 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:00.504394 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4f3fc0c4-0ce9-498a-9127-7319f2610509 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:00.504873 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4f3fc0c4-0ce9-498a-9127-7319f2610509 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:00.505298 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-4f3fc0c4-0ce9-498a-9127-7319f2610509 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:00.639518 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-4f3fc0c4-0ce9-498a-9127-7319f2610509 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:00.647213 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-4f3fc0c4-0ce9-498a-9127-7319f2610509 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c" status: 200 len: 1513 microversion: 2.1 time: 0.155726 Aug 31 00:46:00.648029 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 600/1172] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:00 2022] GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:01.332638 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-ad3d8de0-f896-4e69-8b59-c8c32e34dd5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:01.333334 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-ad3d8de0-f896-4e69-8b59-c8c32e34dd5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:01.339766 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ad3d8de0-f896-4e69-8b59-c8c32e34dd5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:01.340251 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ad3d8de0-f896-4e69-8b59-c8c32e34dd5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:01.340719 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ad3d8de0-f896-4e69-8b59-c8c32e34dd5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:01.341409 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ad3d8de0-f896-4e69-8b59-c8c32e34dd5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:01.341861 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ad3d8de0-f896-4e69-8b59-c8c32e34dd5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:01.342286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-ad3d8de0-f896-4e69-8b59-c8c32e34dd5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:01.487663 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-ad3d8de0-f896-4e69-8b59-c8c32e34dd5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:01.487663 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-ad3d8de0-f896-4e69-8b59-c8c32e34dd5b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1358 microversion: 2.1 time: 0.153585 Aug 31 00:46:01.487663 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 573/1173] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:01 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:01.669266 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-90d60718-8c12-4a29-aedd-78f343eaf16e tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:01.669851 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-90d60718-8c12-4a29-aedd-78f343eaf16e tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:01.676185 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-90d60718-8c12-4a29-aedd-78f343eaf16e tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:01.676698 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-90d60718-8c12-4a29-aedd-78f343eaf16e tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:01.677131 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-90d60718-8c12-4a29-aedd-78f343eaf16e tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:01.677813 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-90d60718-8c12-4a29-aedd-78f343eaf16e tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:01.678260 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-90d60718-8c12-4a29-aedd-78f343eaf16e tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:01.678684 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-90d60718-8c12-4a29-aedd-78f343eaf16e tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:01.809815 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-90d60718-8c12-4a29-aedd-78f343eaf16e tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:01.817534 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-90d60718-8c12-4a29-aedd-78f343eaf16e tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c" status: 200 len: 1513 microversion: 2.1 time: 0.152240 Aug 31 00:46:01.818092 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 601/1174] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:01 2022] GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:02.503309 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-bbd219e7-45db-4083-9a17-8b0a7521af70 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:02.503926 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-bbd219e7-45db-4083-9a17-8b0a7521af70 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:02.511695 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bbd219e7-45db-4083-9a17-8b0a7521af70 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:02.516420 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bbd219e7-45db-4083-9a17-8b0a7521af70 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:02.516420 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bbd219e7-45db-4083-9a17-8b0a7521af70 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:02.516420 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bbd219e7-45db-4083-9a17-8b0a7521af70 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:02.516420 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bbd219e7-45db-4083-9a17-8b0a7521af70 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:02.517021 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-bbd219e7-45db-4083-9a17-8b0a7521af70 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:02.728156 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-bbd219e7-45db-4083-9a17-8b0a7521af70 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:02.736568 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-bbd219e7-45db-4083-9a17-8b0a7521af70 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1358 microversion: 2.1 time: 0.237227 Aug 31 00:46:02.737200 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 574/1175] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:02 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:02.839764 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-5323e107-da9e-4264-bbcb-7eba745e27b0 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:02.840406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-5323e107-da9e-4264-bbcb-7eba745e27b0 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:02.847635 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5323e107-da9e-4264-bbcb-7eba745e27b0 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:02.848554 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5323e107-da9e-4264-bbcb-7eba745e27b0 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:02.849191 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5323e107-da9e-4264-bbcb-7eba745e27b0 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:02.849900 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5323e107-da9e-4264-bbcb-7eba745e27b0 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:02.850356 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5323e107-da9e-4264-bbcb-7eba745e27b0 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:02.850790 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5323e107-da9e-4264-bbcb-7eba745e27b0 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:02.993006 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-5323e107-da9e-4264-bbcb-7eba745e27b0 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:03.001142 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-5323e107-da9e-4264-bbcb-7eba745e27b0 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c" status: 200 len: 1513 microversion: 2.1 time: 0.165965 Aug 31 00:46:03.001958 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 602/1176] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:02 2022] GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:46:03.660190 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-d11bc4a6-591f-4db0-a9d3-c8de8f1773b7 req-f4c5e22e-c891-437d-a1f3-3e8c8405324b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c839a0-df66-4eec-8f4a-bf2160a9614c", "name": "network-vif-deleted", "tag": "f625dbe5-be40-4583-b5d1-459287f0f584"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:46:03.670720 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-d11bc4a6-591f-4db0-a9d3-c8de8f1773b7 req-f4c5e22e-c891-437d-a1f3-3e8c8405324b service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:03.671194 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-d11bc4a6-591f-4db0-a9d3-c8de8f1773b7 req-f4c5e22e-c891-437d-a1f3-3e8c8405324b service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:03.671643 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-d11bc4a6-591f-4db0-a9d3-c8de8f1773b7 req-f4c5e22e-c891-437d-a1f3-3e8c8405324b service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:03.685502 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-d11bc4a6-591f-4db0-a9d3-c8de8f1773b7 req-f4c5e22e-c891-437d-a1f3-3e8c8405324b service nova] Creating event network-vif-deleted:f625dbe5-be40-4583-b5d1-459287f0f584 for instance 29c839a0-df66-4eec-8f4a-bf2160a9614c on hv-cinder-85221 Aug 31 00:46:03.690331 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-d11bc4a6-591f-4db0-a9d3-c8de8f1773b7 req-f4c5e22e-c891-437d-a1f3-3e8c8405324b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033993 Aug 31 00:46:03.691195 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 575/1177] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:46:03.757671 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-5c2f2541-a51f-4c94-8498-1c5ad80da539 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:03.758358 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-5c2f2541-a51f-4c94-8498-1c5ad80da539 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:03.764282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5c2f2541-a51f-4c94-8498-1c5ad80da539 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:03.764985 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5c2f2541-a51f-4c94-8498-1c5ad80da539 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:03.767579 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5c2f2541-a51f-4c94-8498-1c5ad80da539 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:03.767579 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5c2f2541-a51f-4c94-8498-1c5ad80da539 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:03.767579 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5c2f2541-a51f-4c94-8498-1c5ad80da539 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:03.767579 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5c2f2541-a51f-4c94-8498-1c5ad80da539 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:03.904066 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-5c2f2541-a51f-4c94-8498-1c5ad80da539 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:03.912473 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-5c2f2541-a51f-4c94-8498-1c5ad80da539 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1358 microversion: 2.1 time: 0.158655 Aug 31 00:46:03.913029 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 603/1178] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:03 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:04.025639 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7f13cd13-a185-49a1-a488-794fe6a30a69 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:04.026345 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7f13cd13-a185-49a1-a488-794fe6a30a69 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:04.032739 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f13cd13-a185-49a1-a488-794fe6a30a69 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:04.033221 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f13cd13-a185-49a1-a488-794fe6a30a69 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:04.033648 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f13cd13-a185-49a1-a488-794fe6a30a69 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:04.034325 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f13cd13-a185-49a1-a488-794fe6a30a69 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:04.034768 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f13cd13-a185-49a1-a488-794fe6a30a69 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:04.035186 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f13cd13-a185-49a1-a488-794fe6a30a69 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:04.065808 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f13cd13-a185-49a1-a488-794fe6a30a69 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:04.066273 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f13cd13-a185-49a1-a488-794fe6a30a69 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:04.066697 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7f13cd13-a185-49a1-a488-794fe6a30a69 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:04.067131 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-7f13cd13-a185-49a1-a488-794fe6a30a69 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lazy-loading 'fault' on Instance uuid 29c839a0-df66-4eec-8f4a-bf2160a9614c {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:46:04.108984 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-7f13cd13-a185-49a1-a488-794fe6a30a69 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c936369a3ff4138833cfc81a1104f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '644ca4166ff846fb944c2b39f0263abe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:04.116581 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-7f13cd13-a185-49a1-a488-794fe6a30a69 tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c" status: 200 len: 1308 microversion: 2.1 time: 0.096026 Aug 31 00:46:04.117211 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 576/1179] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:04 2022] GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:46:04.934164 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-b18ca863-c8c9-4e59-9b49-a47c700197d9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:04.934774 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-b18ca863-c8c9-4e59-9b49-a47c700197d9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:04.941355 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b18ca863-c8c9-4e59-9b49-a47c700197d9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:04.941841 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b18ca863-c8c9-4e59-9b49-a47c700197d9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:04.942307 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b18ca863-c8c9-4e59-9b49-a47c700197d9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:04.943006 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b18ca863-c8c9-4e59-9b49-a47c700197d9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:04.943467 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b18ca863-c8c9-4e59-9b49-a47c700197d9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:04.943893 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-b18ca863-c8c9-4e59-9b49-a47c700197d9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:05.087099 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-b18ca863-c8c9-4e59-9b49-a47c700197d9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:05.095889 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-b18ca863-c8c9-4e59-9b49-a47c700197d9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1358 microversion: 2.1 time: 0.166080 Aug 31 00:46:05.096719 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 604/1180] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:04 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:05.138578 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9e0cd233-43a6-481e-8494-0c6cca0d9c6c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:05.139194 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9e0cd233-43a6-481e-8494-0c6cca0d9c6c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] [instance: 29c839a0-df66-4eec-8f4a-bf2160a9614c] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:05.145823 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9e0cd233-43a6-481e-8494-0c6cca0d9c6c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:05.146338 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9e0cd233-43a6-481e-8494-0c6cca0d9c6c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:05.146779 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9e0cd233-43a6-481e-8494-0c6cca0d9c6c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:05.147744 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9e0cd233-43a6-481e-8494-0c6cca0d9c6c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:05.148199 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9e0cd233-43a6-481e-8494-0c6cca0d9c6c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:05.148666 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9e0cd233-43a6-481e-8494-0c6cca0d9c6c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:05.163355 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-9e0cd233-43a6-481e-8494-0c6cca0d9c6c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] HTTP exception thrown: Instance 29c839a0-df66-4eec-8f4a-bf2160a9614c could not be found. Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9e0cd233-43a6-481e-8494-0c6cca0d9c6c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Request method failure captured: Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c HTTP/1.1 Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDq6gtcOyf8gNSMXJhURSFuRpu8polycWQn5vsp2eyrh0ABCxDr_ybWnI6FJOOGfLIdcBhMlMAWvcq-S92xsC1cwWIiAu_M9yoU_zb4RnCfFs9RT1fwFi_y_Rua6HFHebTA_XgDcI1ci_P4zPUfA7xYWh1r3NvzvgbDTf2EJNRIxc61w Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: 644ca4166ff846fb944c2b39f0263abe Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-VolumesSnapshotTestJSON-240431918 Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:46:05.165246 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:46:05.167078 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/644ca4166ff846fb944c2b39f0263abe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/644ca4166ff846fb944c2b39f0263abe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/644ca4166ff846fb944c2b39f0263abe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_644ca4166ff846fb944c2b39f0263abe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:46:05.167078 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-VolumesSnapshotTestJSON-240431918 Aug 31 00:46:05.167078 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: 644ca4166ff846fb944c2b39f0263abe Aug 31 00:46:05.167078 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-240431918 Aug 31 00:46:05.167078 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-VolumesSnapshotTestJSON-240431918-project Aug 31 00:46:05.167078 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:46:05.167078 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:46:05.167078 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 4c936369a3ff4138833cfc81a1104f20 Aug 31 00:46:05.167078 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-VolumesSnapshotTestJSON-240431918-project Aug 31 00:46:05.167078 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:46:05.167078 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance 29c839a0-df66-4eec-8f4a-bf2160a9614c could not be found. Aug 31 00:46:05.167078 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'id': '29c839a0-df66-4eec-8f4a-bf2160a9614c'} Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29c839a0-df66-4eec-8f4a-bf2160a9614c could not be found. Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:46:05.168124 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:46:05.174286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:46:05.174286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:46:05.174286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:46:05.174286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:46:05.174286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:46:05.174286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:46:05.174286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:46:05.174286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29c839a0-df66-4eec-8f4a-bf2160a9614c could not be found. Aug 31 00:46:05.174286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:46:05.174286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:46:05.174286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:46:05.174286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:46:05.174286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:46:05.174286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:46:05.174286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:46:05.174286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:46:05.174286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29c839a0-df66-4eec-8f4a-bf2160a9614c could not be found. Aug 31 00:46:05.174286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:46:05.175754 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9e0cd233-43a6-481e-8494-0c6cca0d9c6c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] Returning 404 to user: Instance 29c839a0-df66-4eec-8f4a-bf2160a9614c could not be found. {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:46:05.175754 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9e0cd233-43a6-481e-8494-0c6cca0d9c6c tempest-VolumesSnapshotTestJSON-240431918 tempest-VolumesSnapshotTestJSON-240431918-project] 10.222.0.65 "GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c" status: 404 len: 111 microversion: 2.1 time: 0.032787 Aug 31 00:46:05.175754 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 577/1181] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:05 2022] GET /compute/v2.1/servers/29c839a0-df66-4eec-8f4a-bf2160a9614c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:46:05.299150 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-79f3ffc2-7df5-4598-a34d-bbe6832ea5eb req-7990324a-cdb4-492e-968c-8d6ba3cc040c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06", "name": "network-vif-plugged", "status": "completed", "tag": "4573bb31-6b4a-4232-8e8a-7c6328b04848"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:46:05.308808 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-79f3ffc2-7df5-4598-a34d-bbe6832ea5eb req-7990324a-cdb4-492e-968c-8d6ba3cc040c service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:05.309278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-79f3ffc2-7df5-4598-a34d-bbe6832ea5eb req-7990324a-cdb4-492e-968c-8d6ba3cc040c service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:05.309762 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-79f3ffc2-7df5-4598-a34d-bbe6832ea5eb req-7990324a-cdb4-492e-968c-8d6ba3cc040c service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:05.321043 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-79f3ffc2-7df5-4598-a34d-bbe6832ea5eb req-7990324a-cdb4-492e-968c-8d6ba3cc040c service nova] Creating event network-vif-plugged:4573bb31-6b4a-4232-8e8a-7c6328b04848 for instance b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 on hv-cinder-85221 Aug 31 00:46:05.327525 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-79f3ffc2-7df5-4598-a34d-bbe6832ea5eb req-7990324a-cdb4-492e-968c-8d6ba3cc040c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098513 Aug 31 00:46:05.327882 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 605/1182] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:46:06.117239 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-7e558dcd-77e3-4067-b2d4-169b168848bf tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:06.117806 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-7e558dcd-77e3-4067-b2d4-169b168848bf tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:06.124465 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7e558dcd-77e3-4067-b2d4-169b168848bf tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:06.124946 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7e558dcd-77e3-4067-b2d4-169b168848bf tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:06.125383 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7e558dcd-77e3-4067-b2d4-169b168848bf tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:06.126070 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7e558dcd-77e3-4067-b2d4-169b168848bf tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:06.126520 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7e558dcd-77e3-4067-b2d4-169b168848bf tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:06.127017 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-7e558dcd-77e3-4067-b2d4-169b168848bf tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:06.253448 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-7e558dcd-77e3-4067-b2d4-169b168848bf tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:06.261014 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-7e558dcd-77e3-4067-b2d4-169b168848bf tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1358 microversion: 2.1 time: 0.147890 Aug 31 00:46:06.261559 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 578/1183] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:06 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:07.281415 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-e68c744b-e16d-4177-92f3-020f852123ab tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:07.282104 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-e68c744b-e16d-4177-92f3-020f852123ab tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:07.289075 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e68c744b-e16d-4177-92f3-020f852123ab tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:07.289549 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e68c744b-e16d-4177-92f3-020f852123ab tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:07.289974 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e68c744b-e16d-4177-92f3-020f852123ab tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:07.291352 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e68c744b-e16d-4177-92f3-020f852123ab tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:07.291793 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e68c744b-e16d-4177-92f3-020f852123ab tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:07.292208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-e68c744b-e16d-4177-92f3-020f852123ab tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:07.427225 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-e68c744b-e16d-4177-92f3-020f852123ab tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:07.436236 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-e68c744b-e16d-4177-92f3-020f852123ab tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1358 microversion: 2.1 time: 0.159058 Aug 31 00:46:07.437685 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 606/1184] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:07 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:08.457921 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-fbf0a9c8-829e-4c7c-b2a0-8a6ebc1a62aa tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:08.458539 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-fbf0a9c8-829e-4c7c-b2a0-8a6ebc1a62aa tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:08.465363 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fbf0a9c8-829e-4c7c-b2a0-8a6ebc1a62aa tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:08.465876 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fbf0a9c8-829e-4c7c-b2a0-8a6ebc1a62aa tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:08.466339 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fbf0a9c8-829e-4c7c-b2a0-8a6ebc1a62aa tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:08.467023 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fbf0a9c8-829e-4c7c-b2a0-8a6ebc1a62aa tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:08.467493 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fbf0a9c8-829e-4c7c-b2a0-8a6ebc1a62aa tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:08.467906 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fbf0a9c8-829e-4c7c-b2a0-8a6ebc1a62aa tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:08.600926 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fbf0a9c8-829e-4c7c-b2a0-8a6ebc1a62aa tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:08.606846 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-fbf0a9c8-829e-4c7c-b2a0-8a6ebc1a62aa tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1549 microversion: 2.1 time: 0.152773 Aug 31 00:46:08.607401 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 579/1185] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:08 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:08.628050 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-cc7554a0-75d6-4d2e-b72a-cdcf09356432 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:08.628700 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-cc7554a0-75d6-4d2e-b72a-cdcf09356432 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:08.636072 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cc7554a0-75d6-4d2e-b72a-cdcf09356432 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:08.636565 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cc7554a0-75d6-4d2e-b72a-cdcf09356432 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:08.636999 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cc7554a0-75d6-4d2e-b72a-cdcf09356432 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:08.637679 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cc7554a0-75d6-4d2e-b72a-cdcf09356432 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:08.638142 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cc7554a0-75d6-4d2e-b72a-cdcf09356432 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:08.638679 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cc7554a0-75d6-4d2e-b72a-cdcf09356432 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:08.768309 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-cc7554a0-75d6-4d2e-b72a-cdcf09356432 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:08.776894 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-cc7554a0-75d6-4d2e-b72a-cdcf09356432 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1549 microversion: 2.1 time: 0.152665 Aug 31 00:46:08.777452 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 607/1186] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:08 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:08.796297 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-fb443c41-b601-4efa-b021-98a061ffe627 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:08.801095 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-fb443c41-b601-4efa-b021-98a061ffe627 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:08.801868 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-fb443c41-b601-4efa-b021-98a061ffe627 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Searching by: {'deleted': False, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac'} {{(pid=128048) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 00:46:08.809131 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fb443c41-b601-4efa-b021-98a061ffe627 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:08.809614 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fb443c41-b601-4efa-b021-98a061ffe627 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:08.810198 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fb443c41-b601-4efa-b021-98a061ffe627 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:08.810921 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fb443c41-b601-4efa-b021-98a061ffe627 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:08.811405 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fb443c41-b601-4efa-b021-98a061ffe627 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:08.811831 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-fb443c41-b601-4efa-b021-98a061ffe627 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:08.904595 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.multi_cell_list [None req-fb443c41-b601-4efa-b021-98a061ffe627 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128048) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 00:46:08.997379 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-fb443c41-b601-4efa-b021-98a061ffe627 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204724 Aug 31 00:46:08.997968 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 580/1187] 10.222.0.65 () {58 vars in 1125 bytes} [Wed Aug 31 00:46:08 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:46:09.009760 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-ebb0297a-d31f-4635-84bd-9c5a8863db03 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:09.010375 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-ebb0297a-d31f-4635-84bd-9c5a8863db03 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:09.016381 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ebb0297a-d31f-4635-84bd-9c5a8863db03 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:09.016857 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ebb0297a-d31f-4635-84bd-9c5a8863db03 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:09.017282 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ebb0297a-d31f-4635-84bd-9c5a8863db03 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:09.017960 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ebb0297a-d31f-4635-84bd-9c5a8863db03 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:09.018401 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ebb0297a-d31f-4635-84bd-9c5a8863db03 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:09.018817 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-ebb0297a-d31f-4635-84bd-9c5a8863db03 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:09.151244 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-ebb0297a-d31f-4635-84bd-9c5a8863db03 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:09.158940 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-ebb0297a-d31f-4635-84bd-9c5a8863db03 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1549 microversion: 2.1 time: 0.153669 Aug 31 00:46:09.159506 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 608/1188] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:09 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:11.077746 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-2db9f737-01aa-40c5-8597-f3f24d7c8cba tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff494d98-e6cb-41a3-af55-c58e415a8a3e"}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:46:11.080028 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-2db9f737-01aa-40c5-8597-f3f24d7c8cba tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:11.086497 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2db9f737-01aa-40c5-8597-f3f24d7c8cba tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:11.086976 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2db9f737-01aa-40c5-8597-f3f24d7c8cba tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:11.087445 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2db9f737-01aa-40c5-8597-f3f24d7c8cba tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:11.088247 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2db9f737-01aa-40c5-8597-f3f24d7c8cba tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:11.088720 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2db9f737-01aa-40c5-8597-f3f24d7c8cba tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:11.089144 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2db9f737-01aa-40c5-8597-f3f24d7c8cba tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:11.329872 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:11.967501 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-2db9f737-01aa-40c5-8597-f3f24d7c8cba tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "POST /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.893475 Aug 31 00:46:11.968187 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 581/1189] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 31 00:46:11 2022] POST /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06/os-volume_attachments => generated 194 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:46:20.637307 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-7de3ddf8-7043-46d5-bec7-d927f00dd8f1 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:20.638210 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-7de3ddf8-7043-46d5-bec7-d927f00dd8f1 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:20.640637 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:20.641307 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:20.645938 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7de3ddf8-7043-46d5-bec7-d927f00dd8f1 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:20.646442 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7de3ddf8-7043-46d5-bec7-d927f00dd8f1 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:20.646907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7de3ddf8-7043-46d5-bec7-d927f00dd8f1 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:20.647846 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7de3ddf8-7043-46d5-bec7-d927f00dd8f1 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:20.648293 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7de3ddf8-7043-46d5-bec7-d927f00dd8f1 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:20.648769 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-7de3ddf8-7043-46d5-bec7-d927f00dd8f1 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:20.781809 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-7de3ddf8-7043-46d5-bec7-d927f00dd8f1 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:20.789837 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-7de3ddf8-7043-46d5-bec7-d927f00dd8f1 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1595 microversion: 2.1 time: 0.156631 Aug 31 00:46:20.790406 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 609/1190] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:20 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1595 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:46:22.768254 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell0:SELECT=2 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:22.769463 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:22.770218 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:22.775119 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-8cca67d5-ea27-4184-95e5-463014284609 req-7a7c046b-6a44-433a-88a7-6115647905f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06", "tag": "4573bb31-6b4a-4232-8e8a-7c6328b04848"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:46:22.785711 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-8cca67d5-ea27-4184-95e5-463014284609 req-7a7c046b-6a44-433a-88a7-6115647905f6 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:22.786340 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-8cca67d5-ea27-4184-95e5-463014284609 req-7a7c046b-6a44-433a-88a7-6115647905f6 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:22.786881 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-8cca67d5-ea27-4184-95e5-463014284609 req-7a7c046b-6a44-433a-88a7-6115647905f6 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:22.798168 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-8cca67d5-ea27-4184-95e5-463014284609 req-7a7c046b-6a44-433a-88a7-6115647905f6 service nova] Creating event network-changed:4573bb31-6b4a-4232-8e8a-7c6328b04848 for instance b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 on hv-cinder-85221 Aug 31 00:46:22.803357 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-8cca67d5-ea27-4184-95e5-463014284609 req-7a7c046b-6a44-433a-88a7-6115647905f6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036608 Aug 31 00:46:22.804036 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 582/1191] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:46:25.240485 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-cc149c09-ea0a-4bc4-97bb-d81a423d591f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1713959658"}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:46:25.241003 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-cc149c09-ea0a-4bc4-97bb-d81a423d591f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:25.249062 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cc149c09-ea0a-4bc4-97bb-d81a423d591f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:25.249580 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cc149c09-ea0a-4bc4-97bb-d81a423d591f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:25.250012 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cc149c09-ea0a-4bc4-97bb-d81a423d591f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:25.250693 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cc149c09-ea0a-4bc4-97bb-d81a423d591f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:25.251142 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cc149c09-ea0a-4bc4-97bb-d81a423d591f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:25.251563 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cc149c09-ea0a-4bc4-97bb-d81a423d591f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:25.381182 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.network.security_group_api [None req-cc149c09-ea0a-4bc4-97bb-d81a423d591f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Adding security group 07895e33-2d77-4e86-bf8c-1fe66c5ceab2 to port 4573bb31-6b4a-4232-8e8a-7c6328b04848 Aug 31 00:46:25.766283 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-cc149c09-ea0a-4bc4-97bb-d81a423d591f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "POST /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06/action" status: 202 len: 0 microversion: 2.1 time: 0.529862 Aug 31 00:46:25.766970 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 610/1192] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 00:46:25 2022] POST /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:46:25.776219 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-c75a05e4-229d-458a-ab0f-4d4465738e18 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:25.777096 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-c75a05e4-229d-458a-ab0f-4d4465738e18 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:25.784838 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c75a05e4-229d-458a-ab0f-4d4465738e18 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:25.785604 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c75a05e4-229d-458a-ab0f-4d4465738e18 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:25.786214 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c75a05e4-229d-458a-ab0f-4d4465738e18 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:25.787206 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c75a05e4-229d-458a-ab0f-4d4465738e18 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:25.788646 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c75a05e4-229d-458a-ab0f-4d4465738e18 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:25.789274 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-c75a05e4-229d-458a-ab0f-4d4465738e18 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:25.858216 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-208e194d-b1f8-43bf-b961-61cb46005e11 req-9b557b2e-30f2-4be0-9841-1fc9ee640e25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06", "tag": "4573bb31-6b4a-4232-8e8a-7c6328b04848"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:46:25.870042 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-208e194d-b1f8-43bf-b961-61cb46005e11 req-9b557b2e-30f2-4be0-9841-1fc9ee640e25 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:25.870519 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-208e194d-b1f8-43bf-b961-61cb46005e11 req-9b557b2e-30f2-4be0-9841-1fc9ee640e25 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:25.870946 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-208e194d-b1f8-43bf-b961-61cb46005e11 req-9b557b2e-30f2-4be0-9841-1fc9ee640e25 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:25.884688 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-208e194d-b1f8-43bf-b961-61cb46005e11 req-9b557b2e-30f2-4be0-9841-1fc9ee640e25 service nova] Creating event network-changed:4573bb31-6b4a-4232-8e8a-7c6328b04848 for instance b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 on hv-cinder-85221 Aug 31 00:46:25.891564 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-208e194d-b1f8-43bf-b961-61cb46005e11 req-9b557b2e-30f2-4be0-9841-1fc9ee640e25 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120347 Aug 31 00:46:25.892167 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 583/1193] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 00:46:25.960083 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-c75a05e4-229d-458a-ab0f-4d4465738e18 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:25.972693 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-c75a05e4-229d-458a-ab0f-4d4465738e18 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1760 microversion: 2.1 time: 0.200570 Aug 31 00:46:25.985210 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 611/1194] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:25 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1760 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:48.656969 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-2266aa2b-937c-4dea-8f24-d13927e0e12a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:46:48.660215 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-2266aa2b-937c-4dea-8f24-d13927e0e12a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:48.668467 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2266aa2b-937c-4dea-8f24-d13927e0e12a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:48.671634 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2266aa2b-937c-4dea-8f24-d13927e0e12a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:48.671634 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2266aa2b-937c-4dea-8f24-d13927e0e12a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:48.671634 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2266aa2b-937c-4dea-8f24-d13927e0e12a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:48.671634 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2266aa2b-937c-4dea-8f24-d13927e0e12a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:48.672025 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2266aa2b-937c-4dea-8f24-d13927e0e12a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:48.896336 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-2266aa2b-937c-4dea-8f24-d13927e0e12a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "POST /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06/action" status: 202 len: 0 microversion: 2.1 time: 0.243762 Aug 31 00:46:48.897498 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 584/1195] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 00:46:48 2022] POST /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:46:48.905554 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-782eecf0-937c-408d-a674-da5d3bcccf1e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:48.906161 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-782eecf0-937c-408d-a674-da5d3bcccf1e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:48.909825 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=6 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:48.910396 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=16 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:48.915374 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-782eecf0-937c-408d-a674-da5d3bcccf1e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:48.915857 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-782eecf0-937c-408d-a674-da5d3bcccf1e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:48.916290 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-782eecf0-937c-408d-a674-da5d3bcccf1e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:48.917082 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-782eecf0-937c-408d-a674-da5d3bcccf1e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:48.917535 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-782eecf0-937c-408d-a674-da5d3bcccf1e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:48.917951 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-782eecf0-937c-408d-a674-da5d3bcccf1e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:49.071328 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-782eecf0-937c-408d-a674-da5d3bcccf1e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:49.080131 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-782eecf0-937c-408d-a674-da5d3bcccf1e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1752 microversion: 2.1 time: 0.178418 Aug 31 00:46:49.081249 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 612/1196] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:48 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:50.103556 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-517b1eac-9351-4ef6-9844-16c1033fd2af tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:50.104276 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-517b1eac-9351-4ef6-9844-16c1033fd2af tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:50.111211 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-517b1eac-9351-4ef6-9844-16c1033fd2af tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:50.111375 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-517b1eac-9351-4ef6-9844-16c1033fd2af tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:50.111962 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-517b1eac-9351-4ef6-9844-16c1033fd2af tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:50.112888 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-517b1eac-9351-4ef6-9844-16c1033fd2af tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:50.113337 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-517b1eac-9351-4ef6-9844-16c1033fd2af tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:50.113761 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-517b1eac-9351-4ef6-9844-16c1033fd2af tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:50.275373 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-517b1eac-9351-4ef6-9844-16c1033fd2af tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:50.284123 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-517b1eac-9351-4ef6-9844-16c1033fd2af tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1757 microversion: 2.1 time: 0.184761 Aug 31 00:46:50.284717 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 585/1197] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:50 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:51.306887 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-759408b1-5e89-42b4-b5bd-d54044c6668c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:51.307506 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-759408b1-5e89-42b4-b5bd-d54044c6668c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:51.313482 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-759408b1-5e89-42b4-b5bd-d54044c6668c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:51.313959 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-759408b1-5e89-42b4-b5bd-d54044c6668c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:51.314596 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-759408b1-5e89-42b4-b5bd-d54044c6668c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:51.315315 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-759408b1-5e89-42b4-b5bd-d54044c6668c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:51.315763 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-759408b1-5e89-42b4-b5bd-d54044c6668c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:51.316179 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-759408b1-5e89-42b4-b5bd-d54044c6668c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:51.488295 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-759408b1-5e89-42b4-b5bd-d54044c6668c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:51.497943 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-759408b1-5e89-42b4-b5bd-d54044c6668c tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1757 microversion: 2.1 time: 0.195039 Aug 31 00:46:51.498584 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 613/1198] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:51 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:52.521925 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-24affc58-b288-4256-9aa7-b525c891b14b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:52.522538 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-24affc58-b288-4256-9aa7-b525c891b14b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:52.529217 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-24affc58-b288-4256-9aa7-b525c891b14b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:52.529693 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-24affc58-b288-4256-9aa7-b525c891b14b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:52.530130 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-24affc58-b288-4256-9aa7-b525c891b14b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:52.530827 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-24affc58-b288-4256-9aa7-b525c891b14b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:52.531281 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-24affc58-b288-4256-9aa7-b525c891b14b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:52.531705 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-24affc58-b288-4256-9aa7-b525c891b14b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:52.680615 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-24affc58-b288-4256-9aa7-b525c891b14b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:52.688973 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-24affc58-b288-4256-9aa7-b525c891b14b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1757 microversion: 2.1 time: 0.171298 Aug 31 00:46:52.689534 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 586/1199] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:52 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:53.711776 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-10541946-35c4-4eaa-9888-3f6f13f26415 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:53.712373 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-10541946-35c4-4eaa-9888-3f6f13f26415 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:53.719172 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-10541946-35c4-4eaa-9888-3f6f13f26415 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:53.719697 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-10541946-35c4-4eaa-9888-3f6f13f26415 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:53.720110 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-10541946-35c4-4eaa-9888-3f6f13f26415 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:53.720832 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-10541946-35c4-4eaa-9888-3f6f13f26415 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:53.721278 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-10541946-35c4-4eaa-9888-3f6f13f26415 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:53.721693 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-10541946-35c4-4eaa-9888-3f6f13f26415 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:53.870914 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-10541946-35c4-4eaa-9888-3f6f13f26415 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:53.879284 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-10541946-35c4-4eaa-9888-3f6f13f26415 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1757 microversion: 2.1 time: 0.172060 Aug 31 00:46:53.880653 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 614/1200] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:53 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:54.902519 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-5dc99d78-df16-4786-942c-a8601401a0cd tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:54.903122 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-5dc99d78-df16-4786-942c-a8601401a0cd tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:54.909484 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5dc99d78-df16-4786-942c-a8601401a0cd tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:54.910715 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5dc99d78-df16-4786-942c-a8601401a0cd tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:54.910715 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5dc99d78-df16-4786-942c-a8601401a0cd tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:54.911157 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5dc99d78-df16-4786-942c-a8601401a0cd tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:54.911956 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5dc99d78-df16-4786-942c-a8601401a0cd tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:54.912404 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-5dc99d78-df16-4786-942c-a8601401a0cd tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:55.060730 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-5dc99d78-df16-4786-942c-a8601401a0cd tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:55.070338 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-5dc99d78-df16-4786-942c-a8601401a0cd tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1757 microversion: 2.1 time: 0.171697 Aug 31 00:46:55.070907 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 587/1201] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:54 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:56.091112 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-fe5c242b-928c-4e1a-909b-51ea3f130726 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:56.091755 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-fe5c242b-928c-4e1a-909b-51ea3f130726 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:56.098300 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fe5c242b-928c-4e1a-909b-51ea3f130726 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:56.099392 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fe5c242b-928c-4e1a-909b-51ea3f130726 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:56.100055 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fe5c242b-928c-4e1a-909b-51ea3f130726 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:56.100778 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fe5c242b-928c-4e1a-909b-51ea3f130726 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:56.101236 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fe5c242b-928c-4e1a-909b-51ea3f130726 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:56.101665 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-fe5c242b-928c-4e1a-909b-51ea3f130726 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:56.247433 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-fe5c242b-928c-4e1a-909b-51ea3f130726 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:56.255799 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-fe5c242b-928c-4e1a-909b-51ea3f130726 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1757 microversion: 2.1 time: 0.168661 Aug 31 00:46:56.256362 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 615/1202] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:56 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:57.278068 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-1c10e189-a95c-4163-bde1-fdde4add6b97 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:57.278682 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-1c10e189-a95c-4163-bde1-fdde4add6b97 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:57.285501 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1c10e189-a95c-4163-bde1-fdde4add6b97 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:57.286662 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1c10e189-a95c-4163-bde1-fdde4add6b97 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:57.287240 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1c10e189-a95c-4163-bde1-fdde4add6b97 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:57.288152 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1c10e189-a95c-4163-bde1-fdde4add6b97 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:57.288620 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1c10e189-a95c-4163-bde1-fdde4add6b97 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:57.289043 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-1c10e189-a95c-4163-bde1-fdde4add6b97 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:57.440307 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-1c10e189-a95c-4163-bde1-fdde4add6b97 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:57.448889 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-1c10e189-a95c-4163-bde1-fdde4add6b97 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1757 microversion: 2.1 time: 0.174690 Aug 31 00:46:57.449554 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 588/1203] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:57 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:58.471473 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-5426982f-b031-4e06-b2a9-9790f266294f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:58.472071 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-5426982f-b031-4e06-b2a9-9790f266294f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:58.479431 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5426982f-b031-4e06-b2a9-9790f266294f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:58.479907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5426982f-b031-4e06-b2a9-9790f266294f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:58.480378 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5426982f-b031-4e06-b2a9-9790f266294f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:58.481055 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5426982f-b031-4e06-b2a9-9790f266294f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:58.481495 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5426982f-b031-4e06-b2a9-9790f266294f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:58.481913 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-5426982f-b031-4e06-b2a9-9790f266294f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:58.635466 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-5426982f-b031-4e06-b2a9-9790f266294f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:58.643850 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-5426982f-b031-4e06-b2a9-9790f266294f tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1757 microversion: 2.1 time: 0.176409 Aug 31 00:46:58.644448 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 616/1204] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:58 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:46:59.668251 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-11b68a53-1fdb-479d-ab5a-0502bb69f96a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:46:59.668966 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-11b68a53-1fdb-479d-ab5a-0502bb69f96a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:46:59.675720 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-11b68a53-1fdb-479d-ab5a-0502bb69f96a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:59.676195 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-11b68a53-1fdb-479d-ab5a-0502bb69f96a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:59.677159 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-11b68a53-1fdb-479d-ab5a-0502bb69f96a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:59.678224 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-11b68a53-1fdb-479d-ab5a-0502bb69f96a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:46:59.678678 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-11b68a53-1fdb-479d-ab5a-0502bb69f96a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:46:59.679145 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-11b68a53-1fdb-479d-ab5a-0502bb69f96a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:46:59.838017 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-11b68a53-1fdb-479d-ab5a-0502bb69f96a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:46:59.846475 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-11b68a53-1fdb-479d-ab5a-0502bb69f96a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1757 microversion: 2.1 time: 0.184413 Aug 31 00:46:59.850196 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 589/1205] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:46:59 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:00.867496 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-d8e4f062-a1aa-4bb5-abd2-db87e356dd7a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:00.868475 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-d8e4f062-a1aa-4bb5-abd2-db87e356dd7a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:00.875058 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8e4f062-a1aa-4bb5-abd2-db87e356dd7a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:00.875539 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8e4f062-a1aa-4bb5-abd2-db87e356dd7a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:00.875974 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8e4f062-a1aa-4bb5-abd2-db87e356dd7a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:00.876705 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8e4f062-a1aa-4bb5-abd2-db87e356dd7a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:00.877155 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8e4f062-a1aa-4bb5-abd2-db87e356dd7a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:00.877580 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-d8e4f062-a1aa-4bb5-abd2-db87e356dd7a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:01.037525 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-d8e4f062-a1aa-4bb5-abd2-db87e356dd7a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:01.046038 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-d8e4f062-a1aa-4bb5-abd2-db87e356dd7a tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1757 microversion: 2.1 time: 0.182787 Aug 31 00:47:01.046585 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 617/1206] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:00 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:02.069007 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d6d5d121-1a11-4ae7-95f3-6dd87a3a8280 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:02.069617 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d6d5d121-1a11-4ae7-95f3-6dd87a3a8280 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:02.076028 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d6d5d121-1a11-4ae7-95f3-6dd87a3a8280 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:02.076547 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d6d5d121-1a11-4ae7-95f3-6dd87a3a8280 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:02.076976 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d6d5d121-1a11-4ae7-95f3-6dd87a3a8280 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:02.077657 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d6d5d121-1a11-4ae7-95f3-6dd87a3a8280 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:02.078104 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d6d5d121-1a11-4ae7-95f3-6dd87a3a8280 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:02.078523 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d6d5d121-1a11-4ae7-95f3-6dd87a3a8280 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:02.222158 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-d6d5d121-1a11-4ae7-95f3-6dd87a3a8280 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:02.233066 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d6d5d121-1a11-4ae7-95f3-6dd87a3a8280 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1757 microversion: 2.1 time: 0.168794 Aug 31 00:47:02.233624 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 590/1207] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:02 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:47:03.254795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-459a0902-d7ab-4bb4-b0f6-f923dd8cca50 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:03.255482 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-459a0902-d7ab-4bb4-b0f6-f923dd8cca50 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:03.261994 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-459a0902-d7ab-4bb4-b0f6-f923dd8cca50 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:03.262470 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-459a0902-d7ab-4bb4-b0f6-f923dd8cca50 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:03.262901 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-459a0902-d7ab-4bb4-b0f6-f923dd8cca50 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:03.263587 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-459a0902-d7ab-4bb4-b0f6-f923dd8cca50 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:03.264036 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-459a0902-d7ab-4bb4-b0f6-f923dd8cca50 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:03.264526 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-459a0902-d7ab-4bb4-b0f6-f923dd8cca50 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:03.418496 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-459a0902-d7ab-4bb4-b0f6-f923dd8cca50 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:03.427077 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-459a0902-d7ab-4bb4-b0f6-f923dd8cca50 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1757 microversion: 2.1 time: 0.175982 Aug 31 00:47:03.427676 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 618/1208] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:03 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:04.449221 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-3d3ae6fc-91dc-456d-8042-5cd1303110d2 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:04.449856 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-3d3ae6fc-91dc-456d-8042-5cd1303110d2 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:04.456726 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3d3ae6fc-91dc-456d-8042-5cd1303110d2 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:04.457204 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3d3ae6fc-91dc-456d-8042-5cd1303110d2 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:04.457632 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3d3ae6fc-91dc-456d-8042-5cd1303110d2 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:04.458913 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3d3ae6fc-91dc-456d-8042-5cd1303110d2 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:04.459338 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3d3ae6fc-91dc-456d-8042-5cd1303110d2 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:04.459746 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-3d3ae6fc-91dc-456d-8042-5cd1303110d2 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:04.604286 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-3d3ae6fc-91dc-456d-8042-5cd1303110d2 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:04.612844 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-3d3ae6fc-91dc-456d-8042-5cd1303110d2 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1757 microversion: 2.1 time: 0.167340 Aug 31 00:47:04.613531 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 591/1209] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:04 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:05.635795 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-936496ca-fae2-47a1-982b-cca2c9f0c53b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:05.636407 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-936496ca-fae2-47a1-982b-cca2c9f0c53b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:05.642899 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-936496ca-fae2-47a1-982b-cca2c9f0c53b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:05.643459 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-936496ca-fae2-47a1-982b-cca2c9f0c53b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:05.643889 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-936496ca-fae2-47a1-982b-cca2c9f0c53b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:05.644593 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-936496ca-fae2-47a1-982b-cca2c9f0c53b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:05.645033 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-936496ca-fae2-47a1-982b-cca2c9f0c53b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:05.645447 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-936496ca-fae2-47a1-982b-cca2c9f0c53b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:05.806659 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-936496ca-fae2-47a1-982b-cca2c9f0c53b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:05.816371 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-936496ca-fae2-47a1-982b-cca2c9f0c53b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1757 microversion: 2.1 time: 0.184434 Aug 31 00:47:05.816947 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 619/1210] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:05 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:06.838187 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-0bcd1946-0efa-4897-be37-7676e85ecd0b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:06.838854 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-0bcd1946-0efa-4897-be37-7676e85ecd0b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:06.845146 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0bcd1946-0efa-4897-be37-7676e85ecd0b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:06.845625 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0bcd1946-0efa-4897-be37-7676e85ecd0b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:06.846053 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0bcd1946-0efa-4897-be37-7676e85ecd0b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:06.846734 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0bcd1946-0efa-4897-be37-7676e85ecd0b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:06.847177 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0bcd1946-0efa-4897-be37-7676e85ecd0b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:06.847592 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-0bcd1946-0efa-4897-be37-7676e85ecd0b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:06.994879 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-0bcd1946-0efa-4897-be37-7676e85ecd0b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:07.003157 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-0bcd1946-0efa-4897-be37-7676e85ecd0b tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1760 microversion: 2.1 time: 0.168849 Aug 31 00:47:07.003708 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 592/1211] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:06 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:39.995512 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-cb739e8c-472c-4f81-b6b1-d690b2b8866e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1713959658"}} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:47:39.996190 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-cb739e8c-472c-4f81-b6b1-d690b2b8866e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:39.998298 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_api:SELECT=16 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:47:39.998971 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG dbcounter [-] [128049] Writing DB stats nova_cell1:SELECT=48 {{(pid=128049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:47:40.003611 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cb739e8c-472c-4f81-b6b1-d690b2b8866e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:40.010214 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cb739e8c-472c-4f81-b6b1-d690b2b8866e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:40.010214 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cb739e8c-472c-4f81-b6b1-d690b2b8866e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:40.010214 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cb739e8c-472c-4f81-b6b1-d690b2b8866e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:40.010214 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cb739e8c-472c-4f81-b6b1-d690b2b8866e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:40.010715 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-cb739e8c-472c-4f81-b6b1-d690b2b8866e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:40.138756 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.network.security_group_api [None req-cb739e8c-472c-4f81-b6b1-d690b2b8866e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Removing security group 07895e33-2d77-4e86-bf8c-1fe66c5ceab2 from port 4573bb31-6b4a-4232-8e8a-7c6328b04848 Aug 31 00:47:40.514429 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-cb739e8c-472c-4f81-b6b1-d690b2b8866e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "POST /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06/action" status: 202 len: 0 microversion: 2.1 time: 0.522004 Aug 31 00:47:40.518842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 620/1212] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 31 00:47:39 2022] POST /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 00:47:40.522729 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [req-27dc5ef8-7bab-4c33-a801-eb5a27bb4760 req-ac6d8626-30bf-4deb-9d76-505de35d4a86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06", "tag": "4573bb31-6b4a-4232-8e8a-7c6328b04848"}]} {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:47:40.528313 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_api:SELECT=22 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:47:40.529302 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG dbcounter [-] [128048] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:47:40.530407 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 00:47:40.530605 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Wed Aug 31 00:47:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.65) !!! Aug 31 00:47:40.538960 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-27dc5ef8-7bab-4c33-a801-eb5a27bb4760 req-ac6d8626-30bf-4deb-9d76-505de35d4a86 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:40.539448 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-27dc5ef8-7bab-4c33-a801-eb5a27bb4760 req-ac6d8626-30bf-4deb-9d76-505de35d4a86 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:40.539914 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [req-27dc5ef8-7bab-4c33-a801-eb5a27bb4760 req-ac6d8626-30bf-4deb-9d76-505de35d4a86 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:40.553321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.compute.server_external_events [req-27dc5ef8-7bab-4c33-a801-eb5a27bb4760 req-ac6d8626-30bf-4deb-9d76-505de35d4a86 service nova] Creating event network-changed:4573bb31-6b4a-4232-8e8a-7c6328b04848 for instance b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 on hv-cinder-85221 Aug 31 00:47:40.558876 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [req-27dc5ef8-7bab-4c33-a801-eb5a27bb4760 req-ac6d8626-30bf-4deb-9d76-505de35d4a86 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040261 Aug 31 00:47:40.559892 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 593/1213] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:47:42.080922 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-667ae30f-a0c4-43a0-b634-14f4e2e687fb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:42.081494 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-667ae30f-a0c4-43a0-b634-14f4e2e687fb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:42.087550 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-667ae30f-a0c4-43a0-b634-14f4e2e687fb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:42.088028 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-667ae30f-a0c4-43a0-b634-14f4e2e687fb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:42.088487 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-667ae30f-a0c4-43a0-b634-14f4e2e687fb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:42.089177 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-667ae30f-a0c4-43a0-b634-14f4e2e687fb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:42.089632 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-667ae30f-a0c4-43a0-b634-14f4e2e687fb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:42.090050 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-667ae30f-a0c4-43a0-b634-14f4e2e687fb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:42.175027 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.objects.instance [None req-667ae30f-a0c4-43a0-b634-14f4e2e687fb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lazy-loading 'services' on Instance uuid b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 {{(pid=128049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:47:42.385319 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-667ae30f-a0c4-43a0-b634-14f4e2e687fb tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06/os-volume_attachments/ff494d98-e6cb-41a3-af55-c58e415a8a3e" status: 202 len: 0 microversion: 2.1 time: 0.308662 Aug 31 00:47:42.386018 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 621/1214] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 00:47:42 2022] DELETE /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06/os-volume_attachments/ff494d98-e6cb-41a3-af55-c58e415a8a3e => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 00:47:42.398275 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-9d2cabc4-1a7e-4a77-94cb-d26761d476f3 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:42.400591 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-9d2cabc4-1a7e-4a77-94cb-d26761d476f3 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:42.409084 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9d2cabc4-1a7e-4a77-94cb-d26761d476f3 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:42.409572 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9d2cabc4-1a7e-4a77-94cb-d26761d476f3 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:42.410000 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9d2cabc4-1a7e-4a77-94cb-d26761d476f3 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:42.410709 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9d2cabc4-1a7e-4a77-94cb-d26761d476f3 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:42.411164 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9d2cabc4-1a7e-4a77-94cb-d26761d476f3 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:42.411695 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-9d2cabc4-1a7e-4a77-94cb-d26761d476f3 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:42.444375 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-9d2cabc4-1a7e-4a77-94cb-d26761d476f3 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053677 Aug 31 00:47:42.444955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 594/1215] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:47:42 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:47:42.576772 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-ff81bfcf-30ca-46a0-a836-6a96b5802fe0 req-6b445b7d-9a35-4279-bca7-87a4a01b0d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06", "tag": "4573bb31-6b4a-4232-8e8a-7c6328b04848"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:47:42.588613 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-ff81bfcf-30ca-46a0-a836-6a96b5802fe0 req-6b445b7d-9a35-4279-bca7-87a4a01b0d87 service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:42.589190 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-ff81bfcf-30ca-46a0-a836-6a96b5802fe0 req-6b445b7d-9a35-4279-bca7-87a4a01b0d87 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:42.589694 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-ff81bfcf-30ca-46a0-a836-6a96b5802fe0 req-6b445b7d-9a35-4279-bca7-87a4a01b0d87 service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:42.601934 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-ff81bfcf-30ca-46a0-a836-6a96b5802fe0 req-6b445b7d-9a35-4279-bca7-87a4a01b0d87 service nova] Creating event network-changed:4573bb31-6b4a-4232-8e8a-7c6328b04848 for instance b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 on hv-cinder-85221 Aug 31 00:47:42.607113 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-ff81bfcf-30ca-46a0-a836-6a96b5802fe0 req-6b445b7d-9a35-4279-bca7-87a4a01b0d87 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034451 Aug 31 00:47:42.607905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 622/1216] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:47:43.459551 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-d2836a47-fe1e-4bce-884c-fdd611048730 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:43.461946 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-d2836a47-fe1e-4bce-884c-fdd611048730 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:43.469280 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d2836a47-fe1e-4bce-884c-fdd611048730 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:43.469859 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d2836a47-fe1e-4bce-884c-fdd611048730 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:43.471162 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d2836a47-fe1e-4bce-884c-fdd611048730 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:43.471927 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d2836a47-fe1e-4bce-884c-fdd611048730 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:43.472871 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d2836a47-fe1e-4bce-884c-fdd611048730 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:43.473321 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-d2836a47-fe1e-4bce-884c-fdd611048730 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:43.506789 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-d2836a47-fe1e-4bce-884c-fdd611048730 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052797 Aug 31 00:47:43.507359 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 595/1217] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:47:43 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:47:44.521895 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-60307f79-bcc3-44b8-ad2e-b90dcdf0db01 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:44.524136 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-60307f79-bcc3-44b8-ad2e-b90dcdf0db01 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:44.530523 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-60307f79-bcc3-44b8-ad2e-b90dcdf0db01 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:44.530999 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-60307f79-bcc3-44b8-ad2e-b90dcdf0db01 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:44.531435 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-60307f79-bcc3-44b8-ad2e-b90dcdf0db01 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:44.532128 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-60307f79-bcc3-44b8-ad2e-b90dcdf0db01 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:44.532608 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-60307f79-bcc3-44b8-ad2e-b90dcdf0db01 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:44.533036 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-60307f79-bcc3-44b8-ad2e-b90dcdf0db01 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:44.562661 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-60307f79-bcc3-44b8-ad2e-b90dcdf0db01 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045964 Aug 31 00:47:44.563804 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 623/1218] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 31 00:47:44 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 00:47:44.574637 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-2a657f89-7805-483b-846b-ebb4b8274644 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:44.575234 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-2a657f89-7805-483b-846b-ebb4b8274644 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:44.582408 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2a657f89-7805-483b-846b-ebb4b8274644 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:44.582874 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2a657f89-7805-483b-846b-ebb4b8274644 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:44.583298 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2a657f89-7805-483b-846b-ebb4b8274644 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:44.583979 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2a657f89-7805-483b-846b-ebb4b8274644 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:44.584438 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2a657f89-7805-483b-846b-ebb4b8274644 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:44.584907 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-2a657f89-7805-483b-846b-ebb4b8274644 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:44.661559 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.wsgi [None req-2a657f89-7805-483b-846b-ebb4b8274644 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] HTTP exception thrown: Instance b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 is not attached to volume ff494d98-e6cb-41a3-af55-c58e415a8a3e Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-2a657f89-7805-483b-846b-ebb4b8274644 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Request method failure captured: Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: request: DELETE /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06/os-volume_attachments/ff494d98-e6cb-41a3-af55-c58e415a8a3e HTTP/1.1 Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept: application/json Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Accept-Encoding: identity Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Connection: close Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Length: 0 Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Content-Type: application/json Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Host: 10.222.0.65 Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: Openstack-System-Scope: None Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: User-Agent: python-urllib3/1.26.12 Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Auth-Token: gAAAAABjDq8nNvL1Nu0gXlaDSU8jhcjIAeTzK9nwiNBR48ioO-nZ-8vsxxNP6__xTMf5HVnZoH39lEvKlqPnwawDi0PUhIw0miyqYXDJGuoTVJNTFWTvN6p8qhoL4z3PaA2eW9etq1mijQYjzO2HGwq26J8cFsBei_Hu-9S5E8n6qrPaNAaECzQ Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Id: None Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Domain-Name: None Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Identity-Status: Confirmed Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Is-Admin-Project: True Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Id: default Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Domain-Name: Default Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Id: 3737c99210b64eac8d7d75f53c1e2cac Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Project-Name: tempest-TestMinimumBasicScenario-646323768 Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Role: member,reader Aug 31 00:47:44.663865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Roles: member,reader Aug 31 00:47:44.665826 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3737c99210b64eac8d7d75f53c1e2cac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3737c99210b64eac8d7d75f53c1e2cac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3737c99210b64eac8d7d75f53c1e2cac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3737c99210b64eac8d7d75f53c1e2cac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:47:44.665826 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant: tempest-TestMinimumBasicScenario-646323768 Aug 31 00:47:44.665826 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Id: 3737c99210b64eac8d7d75f53c1e2cac Aug 31 00:47:44.665826 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-Tenant-Name: tempest-TestMinimumBasicScenario-646323768 Aug 31 00:47:44.665826 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User: tempest-TestMinimumBasicScenario-646323768-project Aug 31 00:47:44.665826 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Id: default Aug 31 00:47:44.665826 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Domain-Name: Default Aug 31 00:47:44.665826 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Id: 23fc9f06d2bb4a0fbc0fc01dda38b522 Aug 31 00:47:44.665826 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: X-User-Name: tempest-TestMinimumBasicScenario-646323768-project Aug 31 00:47:44.665826 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: method: > Aug 31 00:47:44.665826 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: exception: Instance b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 is not attached to volume ff494d98-e6cb-41a3-af55-c58e415a8a3e Aug 31 00:47:44.666669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: action_args: {'server_id': 'b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06', 'id': 'ff494d98-e6cb-41a3-af55-c58e415a8a3e'} Aug 31 00:47:44.666669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:47:44.666669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:47:44.666669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 00:47:44.666669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 00:47:44.666669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 00:47:44.666669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 00:47:44.666669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 00:47:44.666669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 00:47:44.666669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ff494d98-e6cb-41a3-af55-c58e415a8a3e. Aug 31 00:47:44.666669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:47:44.666669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:47:44.666669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:47:44.666669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:47:44.666669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:47:44.666669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:47:44.666669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:47:44.666669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:47:44.666669 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:47:44.668063 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:47:44.668063 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 00:47:44.668063 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 00:47:44.668063 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 is not attached to volume ff494d98-e6cb-41a3-af55-c58e415a8a3e Aug 31 00:47:44.668063 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:47:44.668063 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:47:44.668063 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:47:44.668063 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:47:44.668063 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:47:44.668063 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:47:44.668063 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:47:44.668063 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:47:44.668063 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 is not attached to volume ff494d98-e6cb-41a3-af55-c58e415a8a3e Aug 31 00:47:44.668063 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: ERROR nova.api.openstack.wsgi Aug 31 00:47:44.668063 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-2a657f89-7805-483b-846b-ebb4b8274644 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Returning 404 to user: Instance b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 is not attached to volume ff494d98-e6cb-41a3-af55-c58e415a8a3e {{(pid=128048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:47:44.669164 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-2a657f89-7805-483b-846b-ebb4b8274644 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06/os-volume_attachments/ff494d98-e6cb-41a3-af55-c58e415a8a3e" status: 404 len: 154 microversion: 2.1 time: 0.094794 Aug 31 00:47:44.669164 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 596/1219] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 31 00:47:44 2022] DELETE /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06/os-volume_attachments/ff494d98-e6cb-41a3-af55-c58e415a8a3e => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:47:46.036383 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-201b0b80-8638-4904-b63b-e12bb3d9622e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:46.037109 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-201b0b80-8638-4904-b63b-e12bb3d9622e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:46.043321 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-201b0b80-8638-4904-b63b-e12bb3d9622e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:46.043799 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-201b0b80-8638-4904-b63b-e12bb3d9622e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:46.044231 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-201b0b80-8638-4904-b63b-e12bb3d9622e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:46.044950 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-201b0b80-8638-4904-b63b-e12bb3d9622e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:46.045397 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-201b0b80-8638-4904-b63b-e12bb3d9622e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:46.045817 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-201b0b80-8638-4904-b63b-e12bb3d9622e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:46.071208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-201b0b80-8638-4904-b63b-e12bb3d9622e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Going to try to terminate instance {{(pid=128049) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 00:47:46.359506 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-201b0b80-8638-4904-b63b-e12bb3d9622e tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 204 len: 0 microversion: 2.1 time: 0.327883 Aug 31 00:47:46.360892 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 624/1220] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 31 00:47:46 2022] DELETE /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 00:47:46.371910 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-180ff80d-0820-4d7b-ae2a-acc1207814e7 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:46.372575 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-180ff80d-0820-4d7b-ae2a-acc1207814e7 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:46.381207 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-180ff80d-0820-4d7b-ae2a-acc1207814e7 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:46.381207 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-180ff80d-0820-4d7b-ae2a-acc1207814e7 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:46.381207 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-180ff80d-0820-4d7b-ae2a-acc1207814e7 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:46.381207 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-180ff80d-0820-4d7b-ae2a-acc1207814e7 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:46.381714 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-180ff80d-0820-4d7b-ae2a-acc1207814e7 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:46.381865 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-180ff80d-0820-4d7b-ae2a-acc1207814e7 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:46.529050 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-180ff80d-0820-4d7b-ae2a-acc1207814e7 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:46.537002 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-180ff80d-0820-4d7b-ae2a-acc1207814e7 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1555 microversion: 2.1 time: 0.169033 Aug 31 00:47:46.537563 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 597/1221] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:46 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 00:47:47.561002 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-12cd9b53-4758-4c25-bcfa-e1ff2d62e4ce tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:47.565613 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-12cd9b53-4758-4c25-bcfa-e1ff2d62e4ce tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:47.569289 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12cd9b53-4758-4c25-bcfa-e1ff2d62e4ce tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:47.569771 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12cd9b53-4758-4c25-bcfa-e1ff2d62e4ce tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:47.570208 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12cd9b53-4758-4c25-bcfa-e1ff2d62e4ce tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:47.570905 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12cd9b53-4758-4c25-bcfa-e1ff2d62e4ce tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:47.571417 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12cd9b53-4758-4c25-bcfa-e1ff2d62e4ce tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:47.571844 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-12cd9b53-4758-4c25-bcfa-e1ff2d62e4ce tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:47.710255 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.policy [None req-12cd9b53-4758-4c25-bcfa-e1ff2d62e4ce tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128049) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:47.718233 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-12cd9b53-4758-4c25-bcfa-e1ff2d62e4ce tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1555 microversion: 2.1 time: 0.162587 Aug 31 00:47:47.720087 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 625/1222] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:47 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:48.740300 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-02d4a53a-afff-450a-aa1b-3dcf6e50e7ee tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:48.740952 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-02d4a53a-afff-450a-aa1b-3dcf6e50e7ee tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:48.747484 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-02d4a53a-afff-450a-aa1b-3dcf6e50e7ee tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:48.747965 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-02d4a53a-afff-450a-aa1b-3dcf6e50e7ee tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:48.748416 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-02d4a53a-afff-450a-aa1b-3dcf6e50e7ee tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:48.749102 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-02d4a53a-afff-450a-aa1b-3dcf6e50e7ee tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:48.749548 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-02d4a53a-afff-450a-aa1b-3dcf6e50e7ee tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:48.749955 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-02d4a53a-afff-450a-aa1b-3dcf6e50e7ee tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:48.954550 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-02d4a53a-afff-450a-aa1b-3dcf6e50e7ee tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:48.962460 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-02d4a53a-afff-450a-aa1b-3dcf6e50e7ee tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1555 microversion: 2.1 time: 0.226057 Aug 31 00:47:48.962956 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 598/1223] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:48 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:49.211196 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [req-58016120-fb28-4fcf-9e95-00757eb96390 req-8ab4b871-5340-489b-843c-42fd8fc236fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06", "name": "network-vif-deleted", "tag": "4573bb31-6b4a-4232-8e8a-7c6328b04848"}]} {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 00:47:49.223661 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-58016120-fb28-4fcf-9e95-00757eb96390 req-8ab4b871-5340-489b-843c-42fd8fc236fe service nova] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:49.223661 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-58016120-fb28-4fcf-9e95-00757eb96390 req-8ab4b871-5340-489b-843c-42fd8fc236fe service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:49.223661 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [req-58016120-fb28-4fcf-9e95-00757eb96390 req-8ab4b871-5340-489b-843c-42fd8fc236fe service nova] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:49.236575 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.compute.server_external_events [req-58016120-fb28-4fcf-9e95-00757eb96390 req-8ab4b871-5340-489b-843c-42fd8fc236fe service nova] Creating event network-vif-deleted:4573bb31-6b4a-4232-8e8a-7c6328b04848 for instance b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 on hv-cinder-85221 Aug 31 00:47:49.241604 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [req-58016120-fb28-4fcf-9e95-00757eb96390 req-8ab4b871-5340-489b-843c-42fd8fc236fe service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034247 Aug 31 00:47:49.242605 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 626/1224] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 31 00:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 00:47:49.985639 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-c2574fc0-06b1-4aa6-bc09-e68d1cdd75f9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:49.986451 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.compute.api [None req-c2574fc0-06b1-4aa6-bc09-e68d1cdd75f9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128048) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:49.992802 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2574fc0-06b1-4aa6-bc09-e68d1cdd75f9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:49.993289 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2574fc0-06b1-4aa6-bc09-e68d1cdd75f9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:49.993723 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2574fc0-06b1-4aa6-bc09-e68d1cdd75f9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:49.994423 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2574fc0-06b1-4aa6-bc09-e68d1cdd75f9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:49.994871 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2574fc0-06b1-4aa6-bc09-e68d1cdd75f9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:49.995296 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2574fc0-06b1-4aa6-bc09-e68d1cdd75f9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:50.035559 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2574fc0-06b1-4aa6-bc09-e68d1cdd75f9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:50.036070 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2574fc0-06b1-4aa6-bc09-e68d1cdd75f9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:50.036534 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG oslo_concurrency.lockutils [None req-c2574fc0-06b1-4aa6-bc09-e68d1cdd75f9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:50.036987 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.objects.instance [None req-c2574fc0-06b1-4aa6-bc09-e68d1cdd75f9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lazy-loading 'fault' on Instance uuid b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 {{(pid=128048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 00:47:50.088062 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.policy [None req-c2574fc0-06b1-4aa6-bc09-e68d1cdd75f9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23fc9f06d2bb4a0fbc0fc01dda38b522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3737c99210b64eac8d7d75f53c1e2cac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128048) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 00:47:50.096019 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-c2574fc0-06b1-4aa6-bc09-e68d1cdd75f9 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 200 len: 1348 microversion: 2.1 time: 0.114284 Aug 31 00:47:50.100882 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 599/1225] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:49 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 1348 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 00:47:51.118317 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-bd1241e7-cc39-4019-8833-6bea87f6b353 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '>' {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:51.119016 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.compute.api [None req-bd1241e7-cc39-4019-8833-6bea87f6b353 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] [instance: b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06] Fetching instance by UUID {{(pid=128049) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 00:47:51.125441 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd1241e7-cc39-4019-8833-6bea87f6b353 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:51.125921 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd1241e7-cc39-4019-8833-6bea87f6b353 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:51.126410 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd1241e7-cc39-4019-8833-6bea87f6b353 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:51.127139 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd1241e7-cc39-4019-8833-6bea87f6b353 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Acquiring lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 00:47:51.127668 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd1241e7-cc39-4019-8833-6bea87f6b353 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 00:47:51.128096 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG oslo_concurrency.lockutils [None req-bd1241e7-cc39-4019-8833-6bea87f6b353 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Lock "cc00dc75-3ec6-4d28-be0f-5f2a558d3e31" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 00:47:51.142842 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.wsgi [None req-bd1241e7-cc39-4019-8833-6bea87f6b353 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] HTTP exception thrown: Instance b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 could not be found. Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-bd1241e7-cc39-4019-8833-6bea87f6b353 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Request method failure captured: Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: request: GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 HTTP/1.1 Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept: application/json Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Accept-Encoding: identity Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Connection: close Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Length: 0 Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Content-Type: application/json Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Host: 10.222.0.65 Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: Openstack-System-Scope: None Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: User-Agent: python-urllib3/1.26.12 Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Auth-Token: gAAAAABjDq8nNvL1Nu0gXlaDSU8jhcjIAeTzK9nwiNBR48ioO-nZ-8vsxxNP6__xTMf5HVnZoH39lEvKlqPnwawDi0PUhIw0miyqYXDJGuoTVJNTFWTvN6p8qhoL4z3PaA2eW9etq1mijQYjzO2HGwq26J8cFsBei_Hu-9S5E8n6qrPaNAaECzQ Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Id: None Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Domain-Name: None Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Identity-Status: Confirmed Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Is-Admin-Project: True Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Id: default Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Domain-Name: Default Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Id: 3737c99210b64eac8d7d75f53c1e2cac Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Project-Name: tempest-TestMinimumBasicScenario-646323768 Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Role: member,reader Aug 31 00:47:51.144551 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Roles: member,reader Aug 31 00:47:51.146370 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3737c99210b64eac8d7d75f53c1e2cac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3737c99210b64eac8d7d75f53c1e2cac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3737c99210b64eac8d7d75f53c1e2cac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3737c99210b64eac8d7d75f53c1e2cac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Aug 31 00:47:51.146370 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant: tempest-TestMinimumBasicScenario-646323768 Aug 31 00:47:51.146370 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Id: 3737c99210b64eac8d7d75f53c1e2cac Aug 31 00:47:51.146370 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-Tenant-Name: tempest-TestMinimumBasicScenario-646323768 Aug 31 00:47:51.146370 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User: tempest-TestMinimumBasicScenario-646323768-project Aug 31 00:47:51.146370 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Id: default Aug 31 00:47:51.146370 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Domain-Name: Default Aug 31 00:47:51.146370 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Id: 23fc9f06d2bb4a0fbc0fc01dda38b522 Aug 31 00:47:51.146370 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: X-User-Name: tempest-TestMinimumBasicScenario-646323768-project Aug 31 00:47:51.146370 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: method: > Aug 31 00:47:51.146370 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: exception: Instance b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 could not be found. Aug 31 00:47:51.146370 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: action_args: {'id': 'b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06'} Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: {{(pid=128049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 could not be found. Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 00:47:51.147288 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 00:47:51.148907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 00:47:51.148907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 00:47:51.148907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 00:47:51.148907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 00:47:51.148907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 00:47:51.148907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 00:47:51.148907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 00:47:51.148907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 could not be found. Aug 31 00:47:51.148907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:47:51.148907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 00:47:51.148907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:47:51.148907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 00:47:51.148907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 00:47:51.148907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 00:47:51.148907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 00:47:51.148907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 00:47:51.148907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 could not be found. Aug 31 00:47:51.148907 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: ERROR nova.api.openstack.wsgi Aug 31 00:47:51.150401 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: DEBUG nova.api.openstack.wsgi [None req-bd1241e7-cc39-4019-8833-6bea87f6b353 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Returning 404 to user: Instance b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 could not be found. {{(pid=128049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 00:47:51.150401 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: INFO nova.api.openstack.requestlog [None req-bd1241e7-cc39-4019-8833-6bea87f6b353 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06" status: 404 len: 111 microversion: 2.1 time: 0.032226 Aug 31 00:47:51.150401 dv-cinder-852211-6-iscsi devstack@n-api.service[128049]: [pid: 128049|app: 0|req: 627/1226] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 31 00:47:51 2022] GET /compute/v2.1/servers/b5cf0d3a-0b3a-49ab-99ba-3b2eb80fba06 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 00:47:51.159773 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: DEBUG nova.api.openstack.wsgi [None req-3d202c6e-5537-42c1-81a9-c1771508e689 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] Calling method '.version_select at 0x7f5522265700>' {{(pid=128048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 00:47:51.246330 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: INFO nova.api.openstack.requestlog [None req-3d202c6e-5537-42c1-81a9-c1771508e689 tempest-TestMinimumBasicScenario-646323768 tempest-TestMinimumBasicScenario-646323768-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-193571907" status: 202 len: 0 microversion: 2.1 time: 0.091109 Aug 31 00:47:51.246883 dv-cinder-852211-6-iscsi devstack@n-api.service[128048]: [pid: 128048|app: 0|req: 600/1227] 10.222.0.65 () {58 vars in 1269 bytes} [Wed Aug 31 00:47:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-193571907 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)